2026-11-02T12:34:36.580722Z info FLAG: --concurrency="0" 2026-11-02T12:34:36.580740Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T12:34:36.580744Z info FLAG: --help="false" 2026-11-02T12:34:36.580746Z info FLAG: --log_as_json="false" 2026-11-02T12:34:36.580749Z info FLAG: --log_caller="" 2026-11-02T12:34:36.580751Z info FLAG: --log_output_level="default:info" 2026-11-02T12:34:36.580753Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T12:34:36.580757Z info FLAG: --log_target="[stdout]" 2026-11-02T12:34:36.580759Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T12:34:36.580761Z info FLAG: --outlierLogPath="" 2026-11-02T12:34:36.580763Z info FLAG: --profiling="true" 2026-11-02T12:34:36.580766Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T12:34:36.580768Z info FLAG: --proxyLogLevel="warning" 2026-11-02T12:34:36.580770Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T12:34:36.580772Z info FLAG: --stsPort="0" 2026-11-02T12:34:36.580775Z info FLAG: --templateFile="" 2026-11-02T12:34:36.580776Z info FLAG: --tokenManagerPlugin="" 2026-11-02T12:34:36.580779Z info FLAG: --vklog="0" 2026-11-02T12:34:36.580782Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T12:34:36.580976Z info Proxy role ips=[10.132.0.49] type=router id=maas-default-gateway-openshift-default-5bc884dd87-4g2zz.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T12:34:36.581026Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T12:34:36.582035Z info cpu limit detected as 2, setting concurrency 2026-11-02T12:34:36.582578Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T12:34:36.582589Z info JWT policy is third-party-jwt 2026-11-02T12:34:36.582592Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T12:34:36.584117Z info Starting default Istio SDS Server 2026-11-02T12:34:36.584136Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T12:34:36.584154Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T12:34:36.584557Z info Opening status port 15020 2026-11-02T12:34:36.585512Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T12:34:36.586106Z info sds Starting SDS grpc server 2026-11-02T12:34:36.586140Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T12:34:36.586914Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T12:34:36.587734Z info Starting proxy agent 2026-11-02T12:34:36.587764Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T12:34:36.650781Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T12:34:36.765669Z info ads ADS: new connection for node:1 2026-11-02T12:34:36.766156Z info ads ADS: new connection for node:2 2026-11-02T12:34:36.790992Z info cache generated new workload certificate resourceName=default latency=204.744808ms ttl=23h59m59.209010362s 2026-11-02T12:34:36.791024Z info cache Root cert has changed, start rotating root cert 2026-11-02T12:34:36.791050Z info cache returned workload certificate from cache ttl=23h59m59.208953481s 2026-11-02T12:34:36.791059Z info cache returned workload trust anchor from cache ttl=23h59m59.208942174s 2026-11-02T12:34:36.791141Z info cache returned workload trust anchor from cache ttl=23h59m59.208859599s 2026-11-02T12:34:36.792107Z info cache returned workload trust anchor from cache ttl=23h59m59.207894427s 2026-11-02T12:34:36.871349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:34:45.172983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:34:45.919934Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T12:34:46.174510Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T12:34:47.347222Z info Readiness succeeded in 10.769393334s 2026-11-02T12:34:47.347642Z info Envoy proxy is ready 2026-11-02T12:34:51.862573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:34:51.862612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:34:51.862625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:34:51.862630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T12:34:51.642Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 220 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "1b4c3726-bc14-4dba-986a-bf075446602f" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:33430 10.132.0.49:443 10.132.0.17:48696 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T12:34:52.037668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:34:52.037737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:34:52.037765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T12:34:52.037774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T12:34:51.914Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 122 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "53ade25c-564c-4183-9817-1110f09da8be" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:33436 10.132.0.49:443 10.132.0.17:48706 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T12:34:52.091Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 345 145 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "7037eb9e-cd53-477c-8767-0b1bd38694d4" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:41058 10.132.0.49:443 10.132.0.17:48718 - v1-model-routing 2026-11-02T12:34:53.878234Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T12:34:53.878260Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T12:34:53.878263Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T12:34:53.878267Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T12:34:53.583Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 101 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "a83147ff-1a03-47c5-93a3-52705f42ace2" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.17:48726 - v1-model-routing [2026-11-02T12:34:53.859Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 18 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "f4501aa1-916e-41fb-86d6-996a3bc1aafb" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.17:48734 - v1-model-routing 2026-11-02T12:34:54.457241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:34:54.457275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:34:54.457288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T12:34:54.457292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T12:34:54.445Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 12 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "115b308f-c822-450c-924a-5707ad4c66b8" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:33436 10.132.0.49:443 10.132.0.17:48740 - odh-ai-gateway-infra.maas-api-route.4 2026-11-02T12:38:08.716593Z info ads ADS: new connection for node:3 2026-11-02T12:38:08.726025Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T12:38:08.726083Z info cache read certificate from file resource=file-root:system 2026-11-02T12:38:10.761774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:38:16.430328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:38:26.872599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T12:38:27.311Z] "POST /llm/e2e-rt-sw-a14387/anything/e2e-rt-sw-a14387-client HTTP/1.1" 429 - - "-" 124 18 154 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "7143d25a-4329-472c-8a1f-eec18246bd84" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-a14387.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.17:49572 - llm.external-model-e2e-rt-sw-a14387-08a7d64828bf.4 2026-11-02T12:38:37.370014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:38:44.944190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:38:49.833545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:38:49.833705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:38:49.833762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T12:38:49.833795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:38:49.834139Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-02T12:38:50.162308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T12:38:50.311059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:38:50.311096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:38:50.311112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:38:50.311118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T12:38:50.311336Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T12:38:49.659Z] "POST /anything/e2e-rt-eq-ce0ae5-client HTTP/1.1" 200 - via_upstream - "-" 124 1765 174 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "da16f742-46b3-4ae5-a4e5-b40986ce9390" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:36422 10.132.0.49:443 10.132.0.17:41298 - llm.external-model-e2e-rt-eq-ce0ae5-e1d35a9af2c1.0 [2026-11-02T12:38:50.154Z] "POST /anything/e2e-rt-eq-ce0ae5-client HTTP/1.1" 200 - via_upstream - "-" 124 1765 157 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e50db46c-ba67-4fb7-baa9-832bea9419da" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:36428 10.132.0.49:443 10.132.0.17:41302 - llm.external-model-e2e-rt-eq-ce0ae5-e1d35a9af2c1.0 2026-11-02T12:38:51.093926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:38:51.093957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:38:51.093982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:38:51.093987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T12:38:51.094195Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T12:38:50.940Z] "POST /anything/e2e-rt-eq-ce0ae5-client HTTP/1.1" 200 - via_upstream - "-" 124 1769 153 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "49d91c07-1c26-4fea-b228-78fb2968e865" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:45342 10.132.0.49:443 10.132.0.17:41004 - llm.external-model-e2e-rt-eq-ce0ae5-e1d35a9af2c1.0 2026-11-02T12:39:15.681415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:39:16.682662Z info ads ADS: "" 3 terminated with stream closed 2026-11-02T12:39:16.786303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:39:23.230479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:41:13.154365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:41:32.051931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:42:16.842794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:43:19.555122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:43:48.237099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:43:48.237144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:43:48.237165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T12:43:48.237172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T12:43:48.061Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 176 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "ee482ad8-8eda-4ef4-9a05-20dedb579673" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:35440 10.132.0.49:443 10.132.0.17:37006 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T12:43:49.330381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:43:49.330426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:43:49.330447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T12:43:49.330454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T12:43:49.171Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 159 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1c9a8376-9d69-4105-80ee-2d16d071671c" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:35440 10.132.0.49:443 10.132.0.17:37014 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T12:43:51.519869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:43:51.519902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:43:51.519923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:43:51.519928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T12:43:51.405Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 114 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "3ebc5668-e787-439b-9225-c28012268f5f" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:36172 10.132.0.49:443 10.132.0.17:56668 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T12:44:00.934316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T12:44:00.871Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 63 - "44.212.242.249,10.132.0.17" "-" "7f9e7463-776c-475d-9a64-5f9322f5fb4e" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:40492 10.132.0.49:443 10.132.0.17:35344 - v1-completions-path 2026-11-02T12:44:20.959057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T12:44:26.450Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 96 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "7dc01fe2-f101-4876-9222-20e4c5ce470a" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:41058 10.132.0.49:443 10.132.0.17:52548 - v1-completions-path 2026-11-02T12:44:29.540734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:44:29.540771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:44:29.540784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:44:29.540789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T12:44:29.531Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 9 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "0c35d03c-768b-444f-b4cd-16d09a6da1af" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:36172 10.132.0.49:443 10.132.0.17:52560 - odh-ai-gateway-infra.maas-api-route.4 2026-11-02T12:44:37.128570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T12:50:47.272502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:50:47.272548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:50:47.272572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:50:47.272579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T12:50:47.093Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 329 179 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "782aeaa8-bc81-4bcb-a7d9-98af2e20e080" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:59904 10.132.0.49:443 10.132.0.17:44408 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T12:50:47.763023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:50:47.763059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:50:47.763072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:50:47.763077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T12:50:47.763339Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-02T12:50:47.763414Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T12:50:47.763426Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T12:50:47.763430Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T12:50:47.763434Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T12:50:47.625Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 138 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "792e5471-0f01-4302-bf72-7e9221766c9f" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:40492 10.132.0.49:443 10.132.0.17:44420 - v1-completions-path 2026-11-02T12:52:21.080553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:52:21.080612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:52:21.080637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T12:52:21.080646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T12:52:21.081040Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-02T12:52:21.081134Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T12:52:21.081144Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T12:52:21.081148Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T12:52:21.081154Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T12:52:20.077Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 1003 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "aefee7db-52bb-4aec-9613-7507f678541e" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:40492 10.132.0.49:443 10.132.0.17:54790 - v1-chat-completions-path 2026-11-02T13:02:51.454680Z info ads ADS: new connection for node:4 2026-11-02T13:02:51.460871Z info cache read certificate from file resource=file-root:system 2026-11-02T13:07:46.890298Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T13:08:23.352067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:08:54.888052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:09:34.847709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:10:05.281684Z info ads ADS: new connection for node:5 2026-11-02T13:10:05.281957Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T13:10:05.282047Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T13:10:21.188348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:10:55.673038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:11:51.598010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:12:37.792281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:12:44.427322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:12:44.427358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:12:44.427373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:12:44.427380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:12:44.643895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:12:44.643927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:12:44.643938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:12:44.643942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:12:44.644117Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T13:12:44.326Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 100 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "025b46f1-5d91-4d46-8a3f-dfa1771bb734" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:56644 10.132.0.49:443 10.132.0.17:43462 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T13:12:44.446Z] "POST /anything/e2e-dft-cc913b-f27542 HTTP/1.1" 200 - via_upstream - "-" 109 1768 197 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "4734ea25-4c7e-477d-b1e0-4a05c3efb97f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:49064 10.132.0.49:443 10.132.0.17:43474 - llm.external-model-e2e-dft-cc913b-aa39c1c2b348.0 2026-11-02T13:12:57.742796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:13:18.550639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:17:25.251130Z info ads ADS: "" 5 terminated with stream closed 2026-11-02T13:17:27.545719Z info ads ADS: "" 4 terminated with stream closed 2026-11-02T13:22:28.883320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:23:51.686141Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-02T13:23:56.277471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:25:22.170714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:27:03.412233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:38:09.766409Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T13:38:32.218175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:38:32.218224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:38:32.218244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:38:32.218251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T13:38:32.113Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 104 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "475ac9db-78b7-48d3-9434-ace6798b85e0" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:45206 10.132.0.49:443 10.132.0.17:41496 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:38:35.346786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:39:03.309093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:39:34.722586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:39:37.638Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 77 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "febc6da4-22a2-46ac-a3f2-a9a0e3e16cf3" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:42388 10.132.0.49:443 10.132.0.17:34822 - v1-chat-completions-path [2026-11-02T13:39:37.735Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 155 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "fc558d83-80bc-4bf5-96af-cbd2b19c075d" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:42388 10.132.0.49:443 10.132.0.17:34834 - v1-chat-completions-path 2026-11-02T13:39:50.094051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:39:52.377035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:39:55.116161Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-02T13:39:55.032Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 83 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "4acb08d3-0554-9f35-beff-b340ad152a38" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:48356 10.132.0.49:443 10.132.0.17:59664 - v1-catch-all-path 2026-11-02T13:39:58.434791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:40:05.203704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:40:15.501822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:40:30.264155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:40:41.208804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:40:43.057121Z info ads ADS: new connection for node:6 2026-11-02T13:40:43.057314Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T13:40:43.057349Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T13:40:44.926494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:41:25.594377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:41:29.980Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 328 88 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d44bfc8f-880b-4b69-a9a8-2eb6da15c922" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.133.1.23:8000" outbound|54321||e2e-prio-pool-6b4a85cd-inference-pool-ip-09723f29.llm.svc.cluster.local 10.132.0.49:57732 10.132.0.49:443 10.132.0.17:37880 - v1-model-routing 2026-11-02T13:41:44.650266Z info ads ADS: "" 6 terminated 2026-11-02T13:41:44.701321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:41:47.975909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:41:55.707357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:44:13.142693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:44:29.778321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:44:45.820331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:44:57.778990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:45:02.491319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:45:02.876962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:45:02.877007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:45:02.877027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:45:02.877034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T13:45:02.744Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 132 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "60326642-235a-47fe-ae6f-60d883be7d4c" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:39384 10.132.0.49:443 10.132.0.17:35566 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:45:14.953144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:45:19.736489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:45:35.102360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:45:37.941793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:45:37.941858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:45:37.941878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:45:37.941885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T13:45:37.864Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 77 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "173eccc8-93a0-4dec-b8a0-07f9cb29ed64" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:39384 10.132.0.49:443 10.132.0.17:44096 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:46:22.244540Z info ads ADS: new connection for node:7 2026-11-02T13:46:22.250015Z info cache read certificate from file resource=file-root:system 2026-11-02T13:46:23.422504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:46:24.981057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:46:40.685717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:46:40.685749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:46:40.685761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:46:40.685765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:46:40.685939Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T13:46:40.573Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 112 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "00753609-f1bf-491e-aba7-fcf6b531f972" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:52720 10.132.0.49:443 10.132.0.17:33260 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:46:54.376548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:46:54.376609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:46:54.376628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:46:54.376634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:46:54.376948Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T13:46:51.243Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 3133 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "4cdb9fe4-4080-4070-b04e-58abbd7c711e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:51040 10.132.0.49:443 10.132.0.17:34694 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:46:58.608111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:46:58.608142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:46:58.608151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:46:58.608155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:46:58.608290Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T13:46:58.515Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 92 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d0fc523c-c62f-40e4-9de9-a51fbdaff3c5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:52720 10.132.0.49:443 10.132.0.17:34714 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:47:13.478691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:47:13.478725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:47:13.478737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:47:13.478741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:47:13.479014Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T13:47:13.380Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 98 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "3aa53535-2d0a-47c8-a8ef-b5f7eef3459f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:52720 10.132.0.49:443 10.132.0.17:36506 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:47:26.240665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:47:26.240699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:47:26.240711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:47:26.240715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:47:26.240937Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T13:47:26.143Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 97 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "24220dc8-3876-4b99-9f25-7cf643258f92" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.49:51040 10.132.0.49:443 10.132.0.17:41028 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:48:05.358044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:48:05.446147Z info ads ADS: "" 7 terminated with stream closed 2026-11-02T13:48:05.708484Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T13:48:05.708513Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T13:48:05.708516Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T13:48:05.708521Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T13:48:05.673Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 34 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "6213a150-dad2-4ed3-955b-fbf812e7dfb0" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.17:58384 - v1-completions-path 2026-11-02T13:48:06.822593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:48:08.637023Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T13:48:08.637050Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T13:48:08.637054Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T13:48:08.637059Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T13:48:08.540Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 97 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "47444c26-66ce-4b01-a76f-615aa1150d72" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.17:58400 - v1-completions-path 2026-11-02T13:48:13.687899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:48:17.546Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "6a3110e9-0b33-4fad-9c55-cfb39c70dfc6" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.17:40488 - v1-completions-path 2026-11-02T13:48:29.557963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:48:33.821512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:48:34.350Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 117 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "07dc7832-4a85-478b-be4b-442f04bcdc6f" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58442 10.132.0.49:443 10.132.0.17:42262 - v1-completions-path [2026-11-02T13:48:34.614Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 1743 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f29bb310-bae9-4412-ab7a-ffe625638f93" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58444 10.132.0.49:443 10.132.0.17:42276 - v1-completions-path 2026-11-02T13:48:48.912306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:48:51.190589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:48:54.137343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:49:04.501359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:49:09.847Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 64 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "07d7c4d6-73b7-4129-915e-d4ca744b5b89" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58444 10.132.0.49:443 10.132.0.17:33666 - v1-completions-path [2026-11-02T13:49:10.488Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a34f4b1e-8bff-4f1b-b91b-1f5500a4caa4" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.17:56692 - v1-completions-path [2026-11-02T13:49:10.732Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "47ccaa9b-a725-437b-ae32-0a942069bb91" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58444 10.132.0.49:443 10.132.0.17:56696 - v1-completions-path [2026-11-02T13:49:12.406Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "2e12291c-2988-4c92-9c66-1a0bb484e6b4" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58442 10.132.0.49:443 10.132.0.17:56698 - v1-completions-path 2026-11-02T13:49:27.764387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:49:38.115814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:49:42.586369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:49:59.701377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:50:02.139318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:50:09.155584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:50:19.209099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:50:24.288080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:50:32.909606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:50:38.070814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:50:44.336Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 66 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "89b49e51-48cc-4a00-b5ee-8e185fcdc2d0" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:40492 10.132.0.49:443 10.132.0.17:48438 - v1-completions-path 2026-11-02T13:50:56.329997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:50:59.309959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:51:14.478339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:51:15.209340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:51:15.209376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:51:15.209390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:51:15.209394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T13:51:15.131Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 77 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "8687f1da-ed1a-4ff6-8fd5-71c435bf62e0" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:37206 10.132.0.49:443 10.132.0.17:48724 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:51:17.320196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:51:26.468063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:51:32.198Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1f80dc82-8ae6-459c-bb48-bf1e4772b143" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58442 10.132.0.49:443 10.132.0.17:37924 - v1-completions-path 2026-11-02T13:51:44.397888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:51:54.851367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:52:11.818305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:52:15.221495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:54:35.172035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:54:38.568351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:05.556860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:21.018341Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:23.476112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:30.945231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:48.056476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:50.602737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:56:53.516Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 82 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "342ed6b9-f6c4-4953-a2bb-9a85a3610f4e" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58444 10.132.0.49:443 10.132.0.17:56348 - v1-completions-path 2026-11-02T13:57:06.720977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:17.207399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:21.977688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:38.886034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:43.570864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:49.139410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:54.813695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:57:54.813733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:57:54.813749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:57:54.813754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T13:57:54.735Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 310 78 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d2eabc34-3dae-4048-8810-4101053c5afb" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.245:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:52554 10.132.0.49:443 10.132.0.17:44252 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T13:57:54.837Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "9a714f5e-4f10-4a5b-a6e3-d6c312605a4d" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58442 10.132.0.49:443 10.132.0.17:44268 - v1-completions-path [2026-11-02T13:57:55.537Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "8c18be5f-c2a7-4816-8058-2181802b4352" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58442 10.132.0.49:443 10.132.0.17:44280 - v1-completions-path [2026-11-02T13:57:56.514Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "818cf8b6-02e3-4e6f-a62a-fcca209af51e" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58442 10.132.0.49:443 10.132.0.17:44296 - v1-completions-path [2026-11-02T13:57:57.598Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "c8c819b1-45e2-49b5-a3f8-2db92bbbe99c" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58444 10.132.0.49:443 10.132.0.17:44326 - v1-completions-path [2026-11-02T13:57:58.137Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 64 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "4137fdfb-5b8b-4833-ab97-463e176493be" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58444 10.132.0.49:443 10.132.0.17:44330 - v1-completions-path [2026-11-02T13:57:58.501Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f3d8fc96-aad9-4b5d-8f7d-b85139918aaa" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58444 10.132.0.49:443 10.132.0.17:44346 - v1-completions-path 2026-11-02T13:58:11.584019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:21.880891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:26.578407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:29.539492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:34.606629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:58:39.768Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "dbd4a0d1-a43f-44c9-8613-dca18e601b66" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:58442 10.132.0.49:443 10.132.0.17:40686 - v1-completions-path 2026-11-02T13:58:53.701156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:03.188678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:05.595882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:15.501045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:20.080102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:35.841296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:38.306230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:56.557530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:07.012862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:17.280041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:27.652305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:38.098671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:48.420521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:58.810796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:09.134368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:19.531972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:29.892085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:01:32.503Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 71 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "27c81f24-1ef2-4576-a74d-f0bca77a23b3" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:40492 10.132.0.49:443 10.132.0.17:60096 - v1-completions-path [2026-11-02T14:01:36.749Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 79 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1875a85b-a314-4270-83d9-37e75957e5fa" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:40492 10.132.0.49:443 10.132.0.17:60106 - v1-completions-path [2026-11-02T14:01:37.053Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 39 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "11d1e9fe-07f9-481e-8fbb-321e49455e31" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.17:60108 - v1-completions-path [2026-11-02T14:01:37.157Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 70 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "dc42b1b5-2350-4784-ba11-94d32c69466f" "maas.apps.fb61810eb63fb79581b6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:51548 10.132.0.49:443 10.132.0.17:60116 - v1-completions-path