2026-10-30T06:41:19.022392Z info FLAG: --concurrency="0" 2026-10-30T06:41:19.022410Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T06:41:19.022414Z info FLAG: --help="false" 2026-10-30T06:41:19.022417Z info FLAG: --log_as_json="false" 2026-10-30T06:41:19.022419Z info FLAG: --log_caller="" 2026-10-30T06:41:19.022421Z info FLAG: --log_output_level="default:info" 2026-10-30T06:41:19.022423Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T06:41:19.022427Z info FLAG: --log_target="[stdout]" 2026-10-30T06:41:19.022430Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T06:41:19.022432Z info FLAG: --outlierLogPath="" 2026-10-30T06:41:19.022434Z info FLAG: --profiling="true" 2026-10-30T06:41:19.022436Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T06:41:19.022438Z info FLAG: --proxyLogLevel="warning" 2026-10-30T06:41:19.022440Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T06:41:19.022443Z info FLAG: --stsPort="0" 2026-10-30T06:41:19.022446Z info FLAG: --templateFile="" 2026-10-30T06:41:19.022449Z info FLAG: --tokenManagerPlugin="" 2026-10-30T06:41:19.022453Z info FLAG: --vklog="0" 2026-10-30T06:41:19.022458Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T06:41:19.022619Z info Proxy role ips=[10.132.0.33] type=router id=maas-default-gateway-openshift-default-59f957fdd7-bh7ht.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T06:41:19.022677Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T06:41:19.023859Z info cpu limit detected as 2, setting concurrency 2026-10-30T06:41:19.024529Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T06:41:19.024540Z info JWT policy is third-party-jwt 2026-10-30T06:41:19.024543Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T06:41:19.026769Z info Starting default Istio SDS Server 2026-10-30T06:41:19.026793Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T06:41:19.026818Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T06:41:19.027518Z info Opening status port 15020 2026-10-30T06:41:19.027914Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T06:41:19.028637Z info sds Starting SDS grpc server 2026-10-30T06:41:19.028651Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T06:41:19.029420Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T06:41:19.030280Z info Starting proxy agent 2026-10-30T06:41:19.030316Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T06:41:19.086907Z info cache generated new workload certificate resourceName=default latency=58.133497ms ttl=23h59m59.913098818s 2026-10-30T06:41:19.086989Z info cache Root cert has changed, start rotating root cert 2026-10-30T06:41:19.087032Z info cache returned workload trust anchor from cache ttl=23h59m59.912969165s 2026-10-30T06:41:19.095975Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T06:41:19.198483Z info ads ADS: new connection for node:1 2026-10-30T06:41:19.198539Z info cache returned workload certificate from cache ttl=23h59m59.801461842s 2026-10-30T06:41:19.198806Z info ads ADS: new connection for node:2 2026-10-30T06:41:19.198870Z info cache returned workload trust anchor from cache ttl=23h59m59.801131013s 2026-10-30T06:41:19.241007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:41:25.752851Z info Readiness succeeded in 6.733026805s 2026-10-30T06:41:25.753197Z info Envoy proxy is ready 2026-10-30T06:41:58.285288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:41:59.657814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:42:31.585798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:42:34.586871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:42:37.063225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:42:39.619671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:42:44.352284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:42:48.587302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:43:18.083Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 64 - "44.212.242.249,10.132.0.10" "curl/7.76.1" "89d41f47-7e70-4c34-907e-e92de3437ff1" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.10:40300 - v1-model-routing 2026-10-30T06:49:44.275837Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:50:11.660263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:51:40.371937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:52:03.892781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:53:46.897110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:46.897145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:46.897159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:46.897164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T06:53:46.812Z] "DELETE /v1/api-keys/aba0a61a-7f3c-45f0-9739-d3d0fa028c25 HTTP/1.1" 200 - via_upstream - "-" 0 370 85 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b1a84657-75e4-4111-abff-b53691395b99" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:37460 10.132.0.33:443 10.132.0.10:55078 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:53:48.012610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:48.012644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:48.012658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:48.012663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T06:53:47.461Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 60 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "db479aed-5b17-42bc-8eae-631fd1b7fb20" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.33:443 10.132.0.10:55084 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T06:53:47.935Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 76 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "409f7e94-1493-4500-a3d7-60baa7504c9b" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:37460 10.132.0.33:443 10.132.0.10:55092 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:53:50.393076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:50.393108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:50.393122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:50.393128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T06:53:50.168Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 47 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "9f77fb9d-dc70-4410-9b81-b510304c580c" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.33:443 10.132.0.10:55120 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T06:53:50.322Z] "DELETE /v1/api-keys/6e7c0d4e-35dd-4aca-b504-ac299eb207ff HTTP/1.1" 200 - via_upstream - "-" 0 321 70 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "6592b1f8-7a1f-45b4-9c86-1fc844981f62" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:37460 10.132.0.33:443 10.132.0.10:33940 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:54:04.925911Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:54:04.925935Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:54:04.925938Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:54:04.925941Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T06:54:04.891Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 34 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "7a842c83-555c-4eea-859b-5c5ed1798af7" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.10:55964 - v1-completions-path 2026-10-30T06:54:18.508448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:54:44.902322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:54:52.713Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 206 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f9847534-c84c-419a-bbdf-aac5bbf93d3c" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:60994 10.132.0.33:443 10.132.0.10:46878 - v1-completions-path 2026-10-30T06:54:54.964874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:54:54.964990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:54:54.965048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:54:54.965075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T06:54:54.923Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 41 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "5ff89af7-2551-4918-a8e9-f8ce479b06a3" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:57672 10.132.0.33:443 10.132.0.10:46894 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T06:58:43.796235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T06:58:43.805281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:58:43.805312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:58:43.805328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:58:43.805334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T06:58:43.698Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 106 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "1dcebb9a-5525-4768-a681-161cd986a6eb" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:57512 10.132.0.33:443 10.132.0.10:34286 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:02:08.671157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:02:08.671193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:02:08.671207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:02:08.671212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T07:02:08.352Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 23 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "ecd1f937-c3ef-4c0d-81bc-603b281df493" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.33:443 10.132.0.10:51656 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T07:02:08.572Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 98 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "4d4d09be-2310-4a1b-8193-f377706619ed" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:48006 10.132.0.33:443 10.132.0.10:51672 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T07:04:05.349Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 338 123 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "8ecb9f4c-7dba-48c8-b3d5-64214335e631" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:60994 10.132.0.33:443 10.132.0.10:52288 - v1-chat-completions-path [2026-10-30T07:04:05.492Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 316 89 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "85832701-0739-4e6b-811c-b1db1378d0e2" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:51210 10.132.0.33:443 10.132.0.10:52304 - v1-chat-completions-path 2026-10-30T07:09:06.942380Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T07:14:23.776484Z info ads ADS: new connection for node:3 2026-10-30T07:14:23.840854Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T07:14:23.840913Z info cache read certificate from file resource=file-root:system 2026-10-30T07:18:16.827207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:18:29.681398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:19:03.037939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:19:58.239295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:20:14.698646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:20:17.314983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:20:23.492879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:20:32.594907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:20:38.768640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:20:48.258849Z info ads ADS: new connection for node:4 2026-10-30T07:20:48.260299Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:20:48.260395Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:20:59.967430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:21:10.606553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:21:24.746563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:21:58.537386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:22:03.440232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:22:03.440353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:22:03.440402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:22:03.440445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T07:22:03.291Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 148 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "0e33e0d3-c3c3-494d-a090-6bb70b4580ae" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:40202 10.132.0.33:443 10.132.0.10:33610 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:22:16.139428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:22:43.040232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:24:30.618778Z info ads ADS: "" 4 terminated with stream closed 2026-10-30T07:24:52.646157Z info ads ADS: "" 3 terminated 2026-10-30T07:31:22.484209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:32:43.151721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:36:19.439498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:38:17.502389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:38:22.389994Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T07:46:53.799355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:16.826363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:52.617370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:08.895531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:11.374452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:19.026273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:24.510362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:48:24.510401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:48:24.510416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:48:24.510421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T07:48:24.434Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 75 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "03707149-6668-4d0b-bb89-d2fe50f887a0" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:56654 10.132.0.33:443 10.132.0.10:38926 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:48:37.076093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:39.300329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:53.887591Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:05.140010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:06.954454Z info ads ADS: new connection for node:5 2026-10-30T07:49:06.954770Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:49:08.826429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:49.517222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:49:53.204Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 329 88 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "6075ced6-4d35-4316-9a6a-99c0edfda55d" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.1.13:8000" outbound|54321||e2e-prio-pool-0fdfdccb-inference-pool-ip-2d07c08b.llm.svc.cluster.local 10.132.0.33:47208 10.132.0.33:443 10.132.0.10:39724 - v1-model-routing 2026-10-30T07:50:08.363136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:08.477752Z info ads ADS: "" 5 terminated 2026-10-30T07:50:10.732195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:13.440190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:18.373024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:53.710247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:10.699758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:26.311590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:38.200369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:44.535082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:56.377715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:00.972671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:07.053326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T07:53:06.999Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e8c74c7e-fe82-43b7-a8d7-3e31aac3c4d2" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.10:55576 - v1-completions-path 2026-10-30T07:53:19.059015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:05.446619Z info ads ADS: new connection for node:6 2026-10-30T07:54:05.455816Z info cache read certificate from file resource=file-root:system 2026-10-30T07:54:06.640728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:07.827229Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:16.888203Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"1190","StreamId":"14658790251082624330"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-10-30T07:54:16.826Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 62 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b320bb71-a090-4c21-a2f2-e37e095cad0f" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.0.33:443 10.132.0.10:42592 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-30T07:54:55.239626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:55.239662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:55.239673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:55.239678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:54:55.239826Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:54:55.055Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1726 184 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e689e488-14be-4b77-8abc-93e8e83eec2b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:55198 10.132.0.33:443 10.132.0.10:32962 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:54:59.477929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:59.477977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:59.477993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:59.478000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:54:59.478140Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:54:59.375Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 102 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "44503a99-c6e3-4ddd-a31f-1ea7cdaa2102" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:55200 10.132.0.33:443 10.132.0.10:32974 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:05.858818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:05.858849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:05.858859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:55:05.858865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:05.859038Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:55:05.769Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1726 89 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b50be4bd-789f-41fa-9115-3a9305d56c25" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:55198 10.132.0.33:443 10.132.0.10:57982 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:14.336179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:14.336211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:14.336223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:55:14.336227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:14.336366Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:55:14.246Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1726 90 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "76c39b3c-9c3b-4774-b434-181d89ac6526" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:55198 10.132.0.33:443 10.132.0.10:50264 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:51.166725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:55:51.288709Z info ads ADS: "" 6 terminated 2026-10-30T07:55:51.553335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:51.553371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:51.553386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:51.553392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:55:51.758760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:55:51.453Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 99 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "819d5055-99a8-4b03-b351-0c78231bb0be" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:34124 10.132.0.33:443 10.132.0.10:47374 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:55:54.715535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:55:59.576063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:56:07.065Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 75 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b9c0773b-07e1-4bd8-9cc2-f49423b7df8b" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:33630 10.132.0.33:443 10.132.0.10:52780 - v1-completions-path [2026-10-30T07:56:07.262Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "c488a882-2af0-4658-8c14-eef204d5e3a8" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:33640 10.132.0.33:443 10.132.0.10:52782 - v1-completions-path 2026-10-30T07:56:19.387213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:56:23.507622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:56:39.190903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:56:55.044873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:57:00.060Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "3c83ed68-44ec-473c-964f-988735e5ac14" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.10:48554 - v1-completions-path [2026-10-30T07:57:01.039Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "23cb0aef-167f-4f51-b371-da59818afb36" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:33630 10.132.0.33:443 10.132.0.10:58944 - v1-completions-path [2026-10-30T07:57:01.197Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 54 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d16887f2-816a-4ed1-9a9b-4845e8c65add" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:33640 10.132.0.33:443 10.132.0.10:58946 - v1-completions-path 2026-10-30T07:57:17.403416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:27.669158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:31.878784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:57:36.865Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "47831f0f-fd37-426d-bc30-3842209ac5d2" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:33630 10.132.0.33:443 10.132.0.10:53628 - v1-completions-path 2026-10-30T07:57:49.118226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:51.366201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:58.753839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:57:58.753880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:57:58.753895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:57:58.753901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T07:57:58.674Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 79 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "1a3e700d-977b-443e-b851-3526e6de7c0c" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:42668 10.132.0.33:443 10.132.0.10:49490 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:58:10.660582Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:15.558279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:58:29.396Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 66 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d05ed98d-8ec8-482f-b8b8-c9edc9f5f670" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:51210 10.132.0.33:443 10.132.0.10:44912 - v1-completions-path 2026-10-30T07:58:30.916041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:33.074120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:50.908079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:01.705690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:04.537046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:11.076005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:59:11.076050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:59:11.076070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:59:11.076077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T07:59:10.999Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 76 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "bdf01793-bef8-485c-a42e-a9f1040152a3" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:39466 10.132.0.33:443 10.132.0.10:37852 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:59:32.676399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:50.658161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:00.992439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:28.681509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:43.895751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:46.094477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:05.246345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:17.326400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:20.894854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T08:04:24.031Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "c3c8579a-2f34-4098-a676-e7dd80d6f5fd" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:33640 10.132.0.33:443 10.132.0.10:56894 - v1-completions-path 2026-10-30T08:04:36.990086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:47.465723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:52.324247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:53.086461Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-30T08:05:09.324216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:14.227141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:17.094041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T08:05:24.090Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "680438ea-7902-4056-903f-a46a1383665c" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:33630 10.132.0.33:443 10.132.0.10:51070 - v1-completions-path [2026-10-30T08:05:24.951Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "5ca3fa44-006b-4fc4-943e-eb907af429f4" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:33640 10.132.0.33:443 10.132.0.10:51080 - v1-completions-path 2026-10-30T08:05:40.135101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:50.506928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:54.885781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:57.605250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:58.165259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T08:05:58.165311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T08:05:58.165331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T08:05:58.165338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T08:05:58.048Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 116 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "ad4909e3-9c2c-41cd-8d9f-120da34164f3" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.1.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46980 10.132.0.33:443 10.132.0.10:57042 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T08:06:01.274488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:18.605523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:28.936450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:31.329334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:40.975243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:46.162857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:02.838751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:22.987353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:33.412030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:43.874840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:54.399322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:04.648141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:15.003307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:25.410807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:35.772999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:46.155764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:56.475768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8