2026-10-29T22:51:38.562657Z info FLAG: --concurrency="0" 2026-10-29T22:51:38.562678Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-29T22:51:38.562683Z info FLAG: --help="false" 2026-10-29T22:51:38.562685Z info FLAG: --log_as_json="false" 2026-10-29T22:51:38.562687Z info FLAG: --log_caller="" 2026-10-29T22:51:38.562689Z info FLAG: --log_output_level="default:info" 2026-10-29T22:51:38.562691Z info FLAG: --log_stacktrace_level="default:none" 2026-10-29T22:51:38.562699Z info FLAG: --log_target="[stdout]" 2026-10-29T22:51:38.562702Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-29T22:51:38.562704Z info FLAG: --outlierLogPath="" 2026-10-29T22:51:38.562706Z info FLAG: --profiling="true" 2026-10-29T22:51:38.562708Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-29T22:51:38.562710Z info FLAG: --proxyLogLevel="warning" 2026-10-29T22:51:38.562712Z info FLAG: --serviceCluster="istio-proxy" 2026-10-29T22:51:38.562714Z info FLAG: --stsPort="0" 2026-10-29T22:51:38.562716Z info FLAG: --templateFile="" 2026-10-29T22:51:38.562718Z info FLAG: --tokenManagerPlugin="" 2026-10-29T22:51:38.562721Z info FLAG: --vklog="0" 2026-10-29T22:51:38.562723Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-29T22:51:38.562896Z info Proxy role ips=[10.134.0.31] type=router id=maas-default-gateway-openshift-default-9dccdc9b7-fbvvd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-29T22:51:38.562955Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-29T22:51:38.564332Z info cpu limit detected as 2, setting concurrency 2026-10-29T22:51:38.564595Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-29T22:51:38.564607Z info JWT policy is third-party-jwt 2026-10-29T22:51:38.564610Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-29T22:51:38.566587Z info Starting default Istio SDS Server 2026-10-29T22:51:38.566608Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-29T22:51:38.566625Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-29T22:51:38.567033Z info Opening status port 15020 2026-10-29T22:51:38.567954Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-29T22:51:38.569913Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-29T22:51:38.571224Z info Starting proxy agent 2026-10-29T22:51:38.571322Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-29T22:51:38.578488Z info sds Starting SDS grpc server 2026-10-29T22:51:38.578516Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-29T22:51:38.642441Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-29T22:51:38.754956Z info cache generated new workload certificate resourceName=default latency=187.214253ms ttl=23h59m59.2450492s 2026-10-29T22:51:38.754990Z info cache Root cert has changed, start rotating root cert 2026-10-29T22:51:38.755026Z info cache returned workload trust anchor from cache ttl=23h59m59.244974457s 2026-10-29T22:51:38.786373Z info ads ADS: new connection for node:1 2026-10-29T22:51:38.786444Z info cache returned workload certificate from cache ttl=23h59m59.213557176s 2026-10-29T22:51:38.786877Z info ads ADS: new connection for node:2 2026-10-29T22:51:38.787150Z info cache returned workload trust anchor from cache ttl=23h59m59.212852098s 2026-10-29T22:51:38.876442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T22:51:46.802041Z info Readiness succeeded in 8.242474578s 2026-10-29T22:51:46.802457Z info Envoy proxy is ready [2026-10-29T22:52:09.245Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 416 80 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "22230edd-bac3-4ebd-8842-2d8c8f24957e" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:35348 10.134.0.31:443 10.132.0.22:56240 - v1-model-routing [2026-10-29T22:52:09.733Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 54 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "4370814e-2658-4e95-9422-7b9e382e7179" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.31:443 10.132.0.22:56256 - v1-model-routing 2026-10-29T22:54:29.684124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:29.684168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:29.684189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:29.684196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T22:54:29.487Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 60 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "25dd23f2-9cb6-472c-b9d6-463908044add" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.31:443 10.132.0.22:32850 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:54:29.573Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 110 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "13e22ac7-45ee-4949-851b-4696806783e8" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:49894 10.134.0.31:443 10.132.0.22:32852 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:54:32.111293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:32.111338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:32.111361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:54:32.111368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:32.398488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:32.398525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:32.398539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T22:54:32.398543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T22:54:32.005Z] "DELETE /v1/api-keys/313e0dc8-0827-409c-8b08-16a5a4fd0e22 HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "43d1d861-8dea-41cf-8920-712904c3c92e" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:49894 10.134.0.31:443 10.132.0.22:32860 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:54:32.291Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 107 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e63aa491-e7bd-4644-b5ab-c91cf22b9c87" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:33870 10.134.0.31:443 10.132.0.22:32868 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:54:33.010126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:33.010177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:33.010197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:33.010204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:54:33.361900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:33.361949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:33.361973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T22:54:33.361986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:33.671002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:33.671049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:33.671071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:33.671078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-29T22:54:32.790Z] "DELETE /v1/api-keys/07d4eb4d-a3a5-41b5-9502-1090916daf52 HTTP/1.1" 200 - via_upstream - "-" 0 321 219 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "90748f15-1910-4081-bf8f-78e14b34c147" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:49894 10.134.0.31:443 10.132.0.22:32882 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:54:33.257Z] "DELETE /v1/api-keys/fcf151ab-c857-4a9c-ad9d-3809a80048b6 HTTP/1.1" 200 - via_upstream - "-" 0 321 104 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "65518133-9267-40b0-b80c-42d5d44d985d" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:33870 10.134.0.31:443 10.132.0.22:32890 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:54:33.573Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 97 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "19b6f279-338a-9b6e-a70d-a0e43bb1bc34" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:33870 10.134.0.31:443 10.132.0.22:32904 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:54:36.426Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 6 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "4d6e3d9d-5d13-4ce1-9474-61a65521ceb1" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.31:443 10.132.0.22:32916 - - [2026-10-29T22:54:36.623Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 6 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d0c93ca1-8e0f-4be8-be9c-db8d953a5207" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.31:443 10.132.0.22:32922 - - 2026-10-29T22:54:44.172555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T22:55:00.180776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T22:58:05.515569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:58:05.515625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:58:05.515646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:58:05.515652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:58:05.695619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:58:05.695664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:58:05.695685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:58:05.695692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T22:58:05.365Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 150 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "766d5299-6fb2-43e3-a9f4-65b8a3c7d66e" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:49622 10.134.0.31:443 10.132.0.22:51134 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:58:05.541Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 154 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "209fa033-6eb3-448a-86c0-e0c0eb5ea9d1" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:49622 10.134.0.31:443 10.132.0.22:51142 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:58:06.401676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:58:06.401792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:58:06.401846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:58:06.401879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:58:06.402204Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-29T22:58:06.402318Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-29T22:58:06.402353Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-29T22:58:06.402378Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-29T22:58:06.402400Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-29T22:58:06.282Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 119 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "41ea6439-3876-45b4-87c3-36c7c333978d" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:35348 10.134.0.31:443 10.132.0.22:51154 - v1-completions-path 2026-10-29T22:59:02.473033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T22:59:17.211039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:02:55.542071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:03:18.519336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:04:01.834048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:04:19.184888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:04:23.517146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-29T23:04:27.111Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "593e1bb0-d42e-4a48-906c-de06b4b46194" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.31:443 10.132.0.22:39518 - v1-completions-path 2026-10-29T23:04:39.210774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:04:54.733067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-29T23:05:02.146Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 70 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6eb4084b-dd0d-4051-af3b-7464879ecf90" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:55526 10.134.0.31:443 10.132.0.22:38340 - v1-completions-path 2026-10-29T23:05:18.229566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:05:28.578504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:05:33.059395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:05:50.177233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:05:52.373295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:06:11.676024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-29T23:06:13.587Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "bf89c075-6e44-42a8-b7ee-1e398e120f78" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:35348 10.134.0.31:443 10.132.0.22:45342 - v1-completions-path 2026-10-29T23:06:16.382239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:06:31.806732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:06:34.094214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:06:52.053209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:07:02.816157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:07:05.704288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:07:24.727370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:07:27.388935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:07:33.225641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:07:33.225674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:07:33.225685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T23:07:33.225690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T23:07:33.152Z] "DELETE /v1/api-keys/e7f63fd3-39fa-413f-b149-cf5d63d3f7d5 HTTP/1.1" 404 - via_upstream - "-" 0 29 73 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c829eeef-e548-4e35-86bc-e6a478735f14" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:49306 10.134.0.31:443 10.132.0.22:52198 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:07:48.638649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:07:51.219289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:09:28.012485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:09:31.152165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:11:01.638544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:11:17.058925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:11:19.201063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:11:32.101215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:12:43.980684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:12:43.980720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:12:43.980736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:12:43.980743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-29T23:12:43.902Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 78 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "a1782b60-18fe-459e-8f6c-31227a832cd4" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:33572 10.134.0.31:443 10.132.0.22:54640 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:12:50.139553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:13:07.304822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:13:22.596800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:13:35.850001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:13:42.646527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:13:52.539066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:14:05.966888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:14:22.959568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:14:33.052872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:14:40.978410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:14:46.984647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-29T23:14:47.003369Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-29T23:14:46.928Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9cd08a46-cd81-4f21-bb1a-132a8ec804a9" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.133.0.24:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:44446 10.134.0.31:443 10.132.0.22:42786 - v1-catch-all-path 2026-10-29T23:14:54.941613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:14:57.038073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:15:17.661128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:15:28.664099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8