2026-10-30T13:45:04.641369Z info FLAG: --concurrency="0" 2026-10-30T13:45:04.641388Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T13:45:04.641392Z info FLAG: --help="false" 2026-10-30T13:45:04.641394Z info FLAG: --log_as_json="false" 2026-10-30T13:45:04.641396Z info FLAG: --log_caller="" 2026-10-30T13:45:04.641399Z info FLAG: --log_output_level="default:info" 2026-10-30T13:45:04.641401Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T13:45:04.641406Z info FLAG: --log_target="[stdout]" 2026-10-30T13:45:04.641408Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T13:45:04.641411Z info FLAG: --outlierLogPath="" 2026-10-30T13:45:04.641413Z info FLAG: --profiling="true" 2026-10-30T13:45:04.641415Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T13:45:04.641417Z info FLAG: --proxyLogLevel="warning" 2026-10-30T13:45:04.641420Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T13:45:04.641422Z info FLAG: --stsPort="0" 2026-10-30T13:45:04.641424Z info FLAG: --templateFile="" 2026-10-30T13:45:04.641426Z info FLAG: --tokenManagerPlugin="" 2026-10-30T13:45:04.641428Z info FLAG: --vklog="0" 2026-10-30T13:45:04.641431Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T13:45:04.641583Z info Proxy role ips=[10.132.1.0] type=router id=maas-default-gateway-openshift-default-58c6585447-m4kcl.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T13:45:04.641633Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T13:45:04.642707Z info cpu limit detected as 2, setting concurrency 2026-10-30T13:45:04.642943Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T13:45:04.642955Z info JWT policy is third-party-jwt 2026-10-30T13:45:04.642958Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T13:45:04.644521Z info Starting default Istio SDS Server 2026-10-30T13:45:04.644542Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T13:45:04.644560Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T13:45:04.644617Z info Opening status port 15020 2026-10-30T13:45:04.645828Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T13:45:04.646345Z info sds Starting SDS grpc server 2026-10-30T13:45:04.646360Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T13:45:04.647344Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T13:45:04.648133Z info Starting proxy agent 2026-10-30T13:45:04.648163Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T13:45:04.711238Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T13:45:04.789079Z info cache generated new workload certificate resourceName=default latency=142.629631ms ttl=23h59m59.210926837s 2026-10-30T13:45:04.789116Z info cache Root cert has changed, start rotating root cert 2026-10-30T13:45:04.789148Z info cache returned workload trust anchor from cache ttl=23h59m59.210852452s 2026-10-30T13:45:04.847814Z info ads ADS: new connection for node:1 2026-10-30T13:45:04.847883Z info cache returned workload certificate from cache ttl=23h59m59.15211963s 2026-10-30T13:45:04.848481Z info ads ADS: new connection for node:2 2026-10-30T13:45:04.848565Z info cache returned workload trust anchor from cache ttl=23h59m59.151436486s 2026-10-30T13:45:04.943108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:12.736665Z info Readiness succeeded in 8.097990346s 2026-10-30T13:45:12.737100Z info Envoy proxy is ready 2026-10-30T13:45:13.737653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:16.267525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:18.906337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:29.585351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:45:35.105Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 87 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "5e26dc47-4bea-49c4-a08f-4fd8f288d8b7" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.0:48392 10.132.1.0:443 10.132.0.16:41840 - v1-completions-path [2026-10-30T13:45:36.097Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 69 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "c39c9354-009c-4d14-86e6-1690800e20ce" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.0:48402 10.132.1.0:443 10.132.0.16:41856 - v1-completions-path 2026-10-30T13:45:36.331042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T13:45:36.186Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "ac13c861-b76a-4b7a-a1c2-c2e4c91d41b7" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.0:48402 10.132.1.0:443 10.132.0.16:41870 - v1-completions-path [2026-10-30T13:45:36.273Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "a8092d9b-1215-4fd5-89f0-f735dfedc9ba" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.0:48402 10.132.1.0:443 10.132.0.16:41872 - v1-completions-path [2026-10-30T13:45:36.925Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "90dd8409-92be-49b1-84f0-1d9e7941f093" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.0:48402 10.132.1.0:443 10.132.0.16:41882 - v1-completions-path 2026-10-30T13:45:53.215801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:03.613815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:07.973226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:46:12.913Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "19c02568-0d2f-4ad0-9dd7-8edce1415954" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.0:48392 10.132.1.0:443 10.132.0.16:36812 - v1-completions-path [2026-10-30T13:46:13.226Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 52 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "71c3efb2-05c8-4827-aa50-1d2b26cf6440" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.0:48402 10.132.1.0:443 10.132.0.16:36828 - v1-completions-path 2026-10-30T13:46:25.272213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:27.404655Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:46.799458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:46:48.806Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 80 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "d243c61c-d83f-4447-a616-d855452df7ef" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.0:36040 10.132.1.0:443 10.132.0.16:34590 - v1-completions-path 2026-10-30T13:46:51.697990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:08.046413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:25.142917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:35.870253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:38.729730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:48:00.364813Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:48:00.364849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:48:00.364865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:48:00.364869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:48:00.287Z] "DELETE /v1/api-keys/040a95ae-b5d7-474d-8ba9-9d9d5ac16773 HTTP/1.1" 200 - via_upstream - "-" 0 375 77 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "a61dc8ab-b558-4825-b072-67cbbcd640a4" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.0:53826 10.132.1.0:443 10.132.0.16:56658 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:51:15.017160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:29.632153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:31.940449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:34.539816Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:51:34.539845Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:51:34.539849Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:51:34.539853Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T13:51:34.363Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 176 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "46120af4-4377-4596-9a8b-870166104ca4" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.0:443 10.132.0.16:51308 - v1-completions-path 2026-10-30T13:51:46.455246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:02.051985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T13:53:02.058288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:53:02.058313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:53:02.058325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:53:02.058330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:53:01.992Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 65 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "07bd93fc-1a66-44ce-8a71-7573b026c345" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.0:34156 10.132.1.0:443 10.132.0.16:39392 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:53:06.802539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:25.196176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:39.420808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:51.363950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:55.178332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:57.654581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:06.933334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:11.149782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:17.343013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:54:17.343052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:54:17.343068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:54:17.343073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:54:17.284Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 525 58 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "5ace8b7b-f482-4a6c-af23-5a946c0a4d85" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.0:54802 10.132.1.0:443 10.132.0.16:39824 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:54:29.668948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:39.698554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:48.228603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:01.233293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:03.340252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:17.962532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:28.818633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8