2026-11-03T21:23:45.497090Z info FLAG: --concurrency="0" 2026-11-03T21:23:45.497107Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T21:23:45.497112Z info FLAG: --help="false" 2026-11-03T21:23:45.497114Z info FLAG: --log_as_json="false" 2026-11-03T21:23:45.497116Z info FLAG: --log_caller="" 2026-11-03T21:23:45.497118Z info FLAG: --log_output_level="default:info" 2026-11-03T21:23:45.497121Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T21:23:45.497125Z info FLAG: --log_target="[stdout]" 2026-11-03T21:23:45.497127Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T21:23:45.497129Z info FLAG: --outlierLogPath="" 2026-11-03T21:23:45.497131Z info FLAG: --profiling="true" 2026-11-03T21:23:45.497133Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T21:23:45.497135Z info FLAG: --proxyLogLevel="warning" 2026-11-03T21:23:45.497138Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T21:23:45.497140Z info FLAG: --stsPort="0" 2026-11-03T21:23:45.497142Z info FLAG: --templateFile="" 2026-11-03T21:23:45.497144Z info FLAG: --tokenManagerPlugin="" 2026-11-03T21:23:45.497146Z info FLAG: --vklog="0" 2026-11-03T21:23:45.497149Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T21:23:45.497281Z info Proxy role ips=[10.133.0.117] type=router id=maas-default-gateway-openshift-default-7bdc57c4cf-xclk7.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T21:23:45.497330Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T21:23:45.498501Z info cpu limit detected as 2, setting concurrency 2026-11-03T21:23:45.498709Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T21:23:45.498720Z info JWT policy is third-party-jwt 2026-11-03T21:23:45.498723Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T21:23:45.500676Z info Starting default Istio SDS Server 2026-11-03T21:23:45.500705Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T21:23:45.500736Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T21:23:45.501066Z info Opening status port 15020 2026-11-03T21:23:45.502319Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T21:23:45.502649Z info sds Starting SDS grpc server 2026-11-03T21:23:45.502688Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T21:23:45.503657Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T21:23:45.504418Z info Starting proxy agent 2026-11-03T21:23:45.504454Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T21:23:45.572527Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T21:23:45.647323Z info cache generated new workload certificate resourceName=default latency=144.555059ms ttl=23h59m59.35268022s 2026-11-03T21:23:45.647355Z info cache Root cert has changed, start rotating root cert 2026-11-03T21:23:45.647384Z info cache returned workload trust anchor from cache ttl=23h59m59.352616303s 2026-11-03T21:23:45.721828Z info ads ADS: new connection for node:1 2026-11-03T21:23:45.721896Z info cache returned workload certificate from cache ttl=23h59m59.278113302s 2026-11-03T21:23:45.723251Z info ads ADS: new connection for node:2 2026-11-03T21:23:45.723604Z info cache returned workload trust anchor from cache ttl=23h59m59.276397296s 2026-11-03T21:23:45.812945Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:23:53.566781Z info Readiness succeeded in 8.07232637s 2026-11-03T21:23:53.567200Z info Envoy proxy is ready 2026-11-03T21:23:54.399653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:23:59.428031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:24:29.718575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:24:44.856972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:25:12.804190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:25:12.804228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:25:12.804242Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T21:25:12.804247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T21:25:12.679Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 320 124 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "cff375cb-7be2-45ce-9801-901b91bcef78" "maas.apps.462fa6d107c658c14111.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.117:36448 10.133.0.117:443 10.132.0.13:55436 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:25:16.007Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 71 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "6d69f41c-f07c-4b8d-8ee4-f8bbfde06bfb" "maas.apps.462fa6d107c658c14111.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.117:51880 10.133.0.117:443 10.132.0.13:55448 - v1-completions-path [2026-11-03T21:25:18.904Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "481ffeca-f2c9-4c5a-bc93-6a9fb7598b52" "maas.apps.462fa6d107c658c14111.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.117:51884 10.133.0.117:443 10.132.0.13:55470 - v1-completions-path 2026-11-03T21:25:37.103863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:25:47.861640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:26:02.934227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T21:26:12.463Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "f0a16f6a-de83-43d4-835c-dff6dea3d121" "maas.apps.462fa6d107c658c14111.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.117:51884 10.133.0.117:443 10.132.0.13:47368 - v1-completions-path 2026-11-03T21:26:26.771233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:26:38.738023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:26:58.345059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:27:05.024245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:27:44.070425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:28:06.017315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:28:19.235741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:28:25.394609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:28:53.265419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:28:58.961280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:29:19.671978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:29:42.719548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:29:53.504782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:30:14.264941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:30:20.467789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:32:41.056985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:32:47.393418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:34:24.346767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:34:41.518498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:34:46.213884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:35:10.895822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:37:45.815990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:38:12.640365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:38:43.979857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:38:55.987384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:02.167800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:13.715202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:26.732568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:31.563476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:41.415222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:39:41.415258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:39:41.415274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:39:41.415280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T21:39:41.415287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T21:39:41.358Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 57 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "3408ea7d-b380-492f-bb6f-1511486eca52" "maas.apps.462fa6d107c658c14111.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.117:38028 10.133.0.117:443 10.132.0.13:35994 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:39:54.905182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:43:49.345120Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:43:49.345143Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:43:49.345145Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:43:49.345149Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T21:43:49.189Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 155 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "f2e64463-0e3c-43aa-a51a-7f039f03bca6" "maas.apps.462fa6d107c658c14111.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.117:443 10.132.0.13:45042 - v1-catch-all-path 2026-11-03T21:43:57.355203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:44:03.912207Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T21:44:03.832Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 79 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "3be0368c-5c04-4656-8c4d-328ee070f089" "maas.apps.462fa6d107c658c14111.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.117:45966 10.133.0.117:443 10.132.0.13:44550 - v1-catch-all-model-routing 2026-11-03T21:44:07.959696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:44:28.962879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:44:33.529695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:44:49.994192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:45:01.691951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9