2026-11-03T19:59:00.737451Z info FLAG: --concurrency="0" 2026-11-03T19:59:00.737468Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T19:59:00.737472Z info FLAG: --help="false" 2026-11-03T19:59:00.737474Z info FLAG: --log_as_json="false" 2026-11-03T19:59:00.737476Z info FLAG: --log_caller="" 2026-11-03T19:59:00.737478Z info FLAG: --log_output_level="default:info" 2026-11-03T19:59:00.737481Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T19:59:00.737485Z info FLAG: --log_target="[stdout]" 2026-11-03T19:59:00.737487Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T19:59:00.737491Z info FLAG: --outlierLogPath="" 2026-11-03T19:59:00.737493Z info FLAG: --profiling="true" 2026-11-03T19:59:00.737495Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T19:59:00.737496Z info FLAG: --proxyLogLevel="warning" 2026-11-03T19:59:00.737498Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T19:59:00.737500Z info FLAG: --stsPort="0" 2026-11-03T19:59:00.737502Z info FLAG: --templateFile="" 2026-11-03T19:59:00.737504Z info FLAG: --tokenManagerPlugin="" 2026-11-03T19:59:00.737507Z info FLAG: --vklog="0" 2026-11-03T19:59:00.737509Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T19:59:00.737731Z info Proxy role ips=[10.132.0.51] type=router id=maas-default-gateway-openshift-default-fcb75c45f-h7vtl.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T19:59:00.737779Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T19:59:00.738811Z info cpu limit detected as 2, setting concurrency 2026-11-03T19:59:00.739366Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T19:59:00.739377Z info JWT policy is third-party-jwt 2026-11-03T19:59:00.739380Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T19:59:00.740636Z info Starting default Istio SDS Server 2026-11-03T19:59:00.740664Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T19:59:00.740690Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T19:59:00.740901Z info Opening status port 15020 2026-11-03T19:59:00.741472Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T19:59:00.743370Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T19:59:00.744944Z info Starting proxy agent 2026-11-03T19:59:00.746154Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T19:59:00.744964Z info sds Starting SDS grpc server 2026-11-03T19:59:00.764024Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T19:59:00.798883Z info cache generated new workload certificate resourceName=default latency=56.990319ms ttl=23h59m59.201120797s 2026-11-03T19:59:00.798911Z info cache Root cert has changed, start rotating root cert 2026-11-03T19:59:00.798941Z info cache returned workload trust anchor from cache ttl=23h59m59.201059798s 2026-11-03T19:59:00.808247Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T19:59:00.896020Z info ads ADS: new connection for node:1 2026-11-03T19:59:00.896085Z info cache returned workload certificate from cache ttl=23h59m59.103917298s 2026-11-03T19:59:00.896117Z info ads ADS: new connection for node:2 2026-11-03T19:59:00.896185Z info cache returned workload trust anchor from cache ttl=23h59m59.103816939s 2026-11-03T19:59:00.937882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:07.391499Z info Readiness succeeded in 6.656561374s 2026-11-03T19:59:07.391812Z info Envoy proxy is ready 2026-11-03T19:59:24.050126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:26.309954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:28.850990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:30.168972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:32.487649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:34.257193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:36.982788Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:40.215561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:57.904989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:59:58.371832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:00:35.870Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 61 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "979a7418-f10c-4458-9cbc-ba10216b1fe6" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.51:443 10.132.0.9:33484 - v1-model-routing 2026-11-03T20:00:36.742049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:00:36.742085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:00:36.742098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:00:36.742103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:00:36.356Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 57 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "a2836adf-0821-4ad2-a634-816cc75fa9dd" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.51:443 10.132.0.9:33498 - v1-model-routing [2026-11-03T20:00:36.683Z] "DELETE /v1/api-keys/e91a765f-6d14-411c-8ff5-98812e2cf788 HTTP/1.1" 200 - via_upstream - "-" 0 365 58 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "56bf877b-1fda-4024-98d7-4e89c0215935" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.51:44138 10.132.0.51:443 10.132.0.9:33514 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:02:52.636563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:52.636601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:52.636618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:52.636624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:02:52.537Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 98 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "67e01443-b9ae-438e-9386-a5db22dc787c" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.51:55384 10.132.0.51:443 10.132.0.9:50936 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:02:53.481Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 54 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c3f670ae-951a-4f7f-9148-86c0c5e5c7da" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.51:443 10.132.0.9:50964 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:02:53.918289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:53.918322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:53.918334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:02:53.918339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:54.542815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:02:54.542862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:02:54.542880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:02:54.542887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:02:53.853Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "994c0c45-397b-46b2-8a4c-2a9b1c486651" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.51:55384 10.132.0.51:443 10.132.0.9:50970 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:02:54.470Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 72 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "a84ba9d1-343a-48d3-849d-60cb6aafaecd" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.51:55390 10.132.0.51:443 10.132.0.9:50982 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:02:56.256902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:02:56.256937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:02:56.256951Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:02:56.256955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:02:56.243Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 13 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "18c8717b-16ed-4cac-85b1-67054c26c7ee" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.51:55390 10.132.0.51:443 10.132.0.9:50988 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-03T20:03:02.446Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 104 - "44.212.242.249,10.132.0.9" "-" "f2683c95-6b4d-47ac-942b-7b64d36423a6" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:56990 10.132.0.51:443 10.132.0.9:39566 - v1-completions-path 2026-11-03T20:03:08.965309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:03:24.138052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:08.605922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:49.118171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:23.646724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:03.702350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:11:16.156099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:13:15.665190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:14:08.738964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:16:40.239736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:27:52.690515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:28:15.694442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:29:00.388155Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:29:00.388180Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:29:00.388183Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:29:00.388187Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T20:29:00.351Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 36 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "cf07ffa1-58d9-4345-a029-3f514ef5ffa4" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.51:443 10.132.0.9:45846 - v1-completions-path 2026-11-03T20:29:02.625479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:29:08.209815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T20:29:08.154Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 84 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "26e92503-64b3-4fbc-843e-7a38638e6f1a" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:55784 10.132.0.51:443 10.132.0.9:45864 - v1-completions-path [2026-11-03T20:29:09.106Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b1b84bd8-74c8-4f1e-8e42-e37028a8aec0" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:55796 10.132.0.51:443 10.132.0.9:45882 - v1-completions-path 2026-11-03T20:29:20.859902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:29:22.665225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:29:39.560648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:29:41.166211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:29:43.900280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:29:52.348027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:29:58.831266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T20:29:58.775Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "a59c3aa1-544f-4b8c-b8f3-d7d16f67fb7c" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:55796 10.132.0.51:443 10.132.0.9:51770 - v1-completions-path 2026-11-03T20:30:16.973867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:30:27.084965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:30:28.934200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:30:34.319Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "a30278c9-914c-4d92-9bb0-bdfb37c3142d" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:55784 10.132.0.51:443 10.132.0.9:57714 - v1-completions-path [2026-11-03T20:30:34.434Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "711b0c4e-fff8-4e51-9b49-59d6855bcce5" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:55784 10.132.0.51:443 10.132.0.9:57722 - v1-completions-path [2026-11-03T20:30:35.144Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "7f1b2827-3b84-46f2-a69c-1cb19bebefe9" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:55796 10.132.0.51:443 10.132.0.9:57726 - v1-completions-path 2026-11-03T20:30:47.649184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:30:49.287285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:30:53.582956Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T20:31:05.842276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:31:08.005198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:31:24.524213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:31:26.130213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:31:42.169818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:31:52.947136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:31:55.581959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:32:09.947Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 40 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "07d7f058-844e-4b75-8353-9f49d37c0f24" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.51:443 10.132.0.9:34344 - v1-completions-path 2026-11-03T20:32:11.536968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:32:13.714918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:32:21.303930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:32:28.425693Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T20:32:39.425455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:32:49.658941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:07.318233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:09.370597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:39:45.106Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 50 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ae052f1f-0303-4a64-a590-0b99409d1db2" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.51:443 10.132.0.9:43726 - v1-completions-path 2026-11-03T20:39:46.663849Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:39:49.049606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:30.359432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:55.174943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:57.163263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:42:14.050054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:40.111307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:56.199577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:11.147727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:44:11.147768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:44:11.147786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:44:11.147792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:44:11.087Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ec3c705e-dc14-4aa6-a57d-a63b57b2fed7" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.51:41752 10.132.0.51:443 10.132.0.9:51490 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:44:12.500983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:24.153224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:27.344474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:44:27.344632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:44:27.344706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:44:27.344740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:44:27.629988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:44:25.036Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 2308 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "dbed1584-e2d2-4190-a4ef-53556cb256c2" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.51:35830 10.132.0.51:443 10.132.0.9:33198 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:44:38.911434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:41.414128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:48.156865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:44:48.156899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:44:48.156912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:44:48.156917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:44:48.095Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 61 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c16dca05-dddd-4b9f-bf13-748008ed6b1c" "maas.apps.93de13b2f0de30a61578.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.51:35830 10.132.0.51:443 10.132.0.9:39444 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:45:00.384625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:47:47.891086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:47:53.045966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:48:08.134572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:48:09.744449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:48:24.027258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:48:34.702008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8