2026-11-03T18:19:00.756152Z info FLAG: --concurrency="0" 2026-11-03T18:19:00.756318Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T18:19:00.756343Z info FLAG: --help="false" 2026-11-03T18:19:00.756360Z info FLAG: --log_as_json="false" 2026-11-03T18:19:00.756376Z info FLAG: --log_caller="" 2026-11-03T18:19:00.756392Z info FLAG: --log_output_level="default:info" 2026-11-03T18:19:00.756407Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T18:19:00.756426Z info FLAG: --log_target="[stdout]" 2026-11-03T18:19:00.756442Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T18:19:00.756457Z info FLAG: --outlierLogPath="" 2026-11-03T18:19:00.756479Z info FLAG: --profiling="true" 2026-11-03T18:19:00.756494Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T18:19:00.756509Z info FLAG: --proxyLogLevel="warning" 2026-11-03T18:19:00.756524Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T18:19:00.756540Z info FLAG: --stsPort="0" 2026-11-03T18:19:00.756555Z info FLAG: --templateFile="" 2026-11-03T18:19:00.756570Z info FLAG: --tokenManagerPlugin="" 2026-11-03T18:19:00.756590Z info FLAG: --vklog="0" 2026-11-03T18:19:00.756624Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T18:19:00.756805Z info Proxy role ips=[10.133.0.222] type=router id=maas-default-gateway-openshift-default-6dcf757899-7jkn9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T18:19:00.756867Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T18:19:00.758098Z info cpu limit detected as 2, setting concurrency 2026-11-03T18:19:00.758325Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T18:19:00.758338Z info JWT policy is third-party-jwt 2026-11-03T18:19:00.758343Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T18:19:00.760087Z info Starting default Istio SDS Server 2026-11-03T18:19:00.760165Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T18:19:00.760225Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T18:19:00.760650Z info Opening status port 15020 2026-11-03T18:19:00.762590Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T18:19:00.764867Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T18:19:00.766099Z info Starting proxy agent 2026-11-03T18:19:00.766207Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T18:19:00.773008Z info sds Starting SDS grpc server 2026-11-03T18:19:00.773059Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T18:19:00.851759Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T18:19:00.973540Z info cache generated new workload certificate resourceName=default latency=210.429521ms ttl=23h59m59.026465977s 2026-11-03T18:19:00.973593Z info cache Root cert has changed, start rotating root cert 2026-11-03T18:19:00.973666Z info cache returned workload trust anchor from cache ttl=23h59m59.026335153s 2026-11-03T18:19:01.024501Z info ads ADS: new connection for node:1 2026-11-03T18:19:01.024585Z info cache returned workload certificate from cache ttl=23h59m58.975417417s 2026-11-03T18:19:01.025675Z info ads ADS: new connection for node:2 2026-11-03T18:19:01.025766Z info cache returned workload trust anchor from cache ttl=23h59m58.974235325s 2026-11-03T18:19:01.133075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:19:10.132284Z info Readiness succeeded in 9.382061028s 2026-11-03T18:19:10.132822Z info Envoy proxy is ready 2026-11-03T18:19:29.895979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:20:14.655596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:20:44.249721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:21:37.941237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:21:59.242685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:22:04.093662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:22:30.573881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:22:47.576145Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:22:54.082524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:22:54.082565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:22:54.082580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:22:54.082585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T18:22:53.959Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 122 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "b3804abd-9b07-44f6-be27-4b39120639d2" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.222:34654 10.133.0.222:443 10.132.0.17:34224 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T18:22:59.693Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 72 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "4eb1e9e3-3bfe-431c-ac6c-cbd70e50e6a3" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.222:50408 10.133.0.222:443 10.132.0.17:56804 - v1-completions-path [2026-11-03T18:23:00.524Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 61 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "2e8bf990-eb34-40e5-96f7-f8a19114764b" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.222:50414 10.133.0.222:443 10.132.0.17:56816 - v1-completions-path [2026-11-03T18:23:01.665Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3f521c85-9fd2-41b9-8f14-faf2b8de9f41" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.222:50414 10.133.0.222:443 10.132.0.17:56824 - v1-completions-path 2026-11-03T18:23:18.664078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:23:29.410213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:23:36.068768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T18:23:48.395Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 108 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "f39ec84d-d6f9-4913-9cf5-af9f5e67e502" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.222:50408 10.133.0.222:443 10.132.0.17:56250 - v1-completions-path 2026-11-03T18:24:04.453856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:24:09.106381Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:24:32.753967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:24:39.179475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:25:05.293213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:25:24.479587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:25:37.511798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:10.592418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:32.405821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:43.086325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:05.256159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T18:29:05.256197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T18:29:05.256212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T18:29:05.256217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T18:29:05.143Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 112 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3db626b8-995a-4f4f-bb9b-340a65d16288" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.222:55334 10.133.0.222:443 10.132.0.17:55378 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:30:54.744054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:31:12.051470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:31:16.654857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:31:41.296343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:33:49.817014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:34:30.669115Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:34:48.638205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:35:03.867763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:35:22.253459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:35:34.678222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:35:39.605765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:36:05.475072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:34.163994Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T18:39:34.164019Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T18:39:34.164022Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T18:39:34.164026Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T18:39:34.007Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 156 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "a29581c8-3d8a-49e5-a537-bd0133aa5059" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.222:443 10.132.0.17:34192 - v1-catch-all-path 2026-11-03T18:39:39.878306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:50.177958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:40:11.221079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:40:15.933622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:40:16.439701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-03T18:40:16.591514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T18:40:16.591584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T18:40:16.591646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T18:40:16.591661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T18:40:16.426Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 164 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "0cabd3a5-4522-4949-bd6c-f8e41e7cedd6" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.134.0.101:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.222:41984 10.133.0.222:443 10.132.0.17:56824 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:40:32.208385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:40:44.034018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9