2026-11-03T00:49:14.702071Z info FLAG: --concurrency="0" 2026-11-03T00:49:14.702090Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T00:49:14.702094Z info FLAG: --help="false" 2026-11-03T00:49:14.702096Z info FLAG: --log_as_json="false" 2026-11-03T00:49:14.702098Z info FLAG: --log_caller="" 2026-11-03T00:49:14.702100Z info FLAG: --log_output_level="default:info" 2026-11-03T00:49:14.702102Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T00:49:14.702106Z info FLAG: --log_target="[stdout]" 2026-11-03T00:49:14.702109Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T00:49:14.702111Z info FLAG: --outlierLogPath="" 2026-11-03T00:49:14.702113Z info FLAG: --profiling="true" 2026-11-03T00:49:14.702116Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T00:49:14.702118Z info FLAG: --proxyLogLevel="warning" 2026-11-03T00:49:14.702120Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T00:49:14.702123Z info FLAG: --stsPort="0" 2026-11-03T00:49:14.702124Z info FLAG: --templateFile="" 2026-11-03T00:49:14.702126Z info FLAG: --tokenManagerPlugin="" 2026-11-03T00:49:14.702129Z info FLAG: --vklog="0" 2026-11-03T00:49:14.702131Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T00:49:14.702293Z info Proxy role ips=[10.134.0.37] type=router id=maas-default-gateway-openshift-default-596dc9545f-s4dc8.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T00:49:14.702347Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T00:49:14.703477Z info cpu limit detected as 2, setting concurrency 2026-11-03T00:49:14.703680Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T00:49:14.703690Z info JWT policy is third-party-jwt 2026-11-03T00:49:14.703693Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T00:49:14.705454Z info Starting default Istio SDS Server 2026-11-03T00:49:14.705482Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T00:49:14.705507Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T00:49:14.705774Z info Opening status port 15020 2026-11-03T00:49:14.706760Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T00:49:14.708305Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T00:49:14.709226Z info Starting proxy agent 2026-11-03T00:49:14.709263Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T00:49:14.710154Z info sds Starting SDS grpc server 2026-11-03T00:49:14.710235Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T00:49:14.777204Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T00:49:14.823992Z info cache generated new workload certificate resourceName=default latency=115.64833ms ttl=23h59m59.176012919s 2026-11-03T00:49:14.824042Z info cache Root cert has changed, start rotating root cert 2026-11-03T00:49:14.824081Z info cache returned workload trust anchor from cache ttl=23h59m59.175919192s 2026-11-03T00:49:14.882157Z info ads ADS: new connection for node:1 2026-11-03T00:49:14.882226Z info cache returned workload certificate from cache ttl=23h59m59.117778368s 2026-11-03T00:49:14.882459Z info ads ADS: new connection for node:2 2026-11-03T00:49:14.882528Z info cache returned workload trust anchor from cache ttl=23h59m59.117473137s 2026-11-03T00:49:14.964562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:49:22.876473Z info Readiness succeeded in 8.177217354s 2026-11-03T00:49:22.876831Z info Envoy proxy is ready 2026-11-03T00:52:19.734124Z info ads ADS: new connection for node:3 2026-11-03T00:52:19.739577Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T00:52:19.739683Z info cache read certificate from file resource=file-root:system 2026-11-03T00:52:20.392612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:52:27.767585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:52:38.309404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:52:51.390236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:53:03.765622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:53:11.329933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:53:11.329983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:53:11.330005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:53:11.330013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:53:11.244Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 85 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "f56fc3bb-6f5c-404e-916b-82f012e41b31" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:44178 10.134.0.37:443 10.132.0.9:54166 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:53:13.035645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.035681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.035691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:53:13.035696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.035888Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-03T00:53:13.463037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.463069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.463079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:53:13.463083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.463241Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-03T00:53:13.881145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.881201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.881227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:53:13.881239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:53:13.881539Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:53:12.887Z] "POST /anything/e2e-rt-eq-a2b99b-client HTTP/1.1" 200 - via_upstream - "-" 124 1758 148 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5579103d-c2b7-421b-82f2-dc02478e58cf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:56240 10.134.0.37:443 10.132.0.9:54170 - llm.external-model-e2e-rt-eq-a2b99b-0458c63ab9fe.0 [2026-11-03T00:53:13.320Z] "POST /anything/e2e-rt-eq-a2b99b-client HTTP/1.1" 200 - via_upstream - "-" 124 1767 142 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "94e9fd4d-970f-4bc2-98d2-05f1be94ded2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:56244 10.134.0.37:443 10.132.0.9:54176 - llm.external-model-e2e-rt-eq-a2b99b-0458c63ab9fe.0 [2026-11-03T00:53:13.719Z] "POST /anything/e2e-rt-eq-a2b99b-client HTTP/1.1" 200 - via_upstream - "-" 124 1760 161 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "374db89d-7520-488f-8741-1ab8f2ab3ea9" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:56258 10.134.0.37:443 10.132.0.9:54178 - llm.external-model-e2e-rt-eq-a2b99b-0458c63ab9fe.0 2026-11-03T00:53:14.966335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:53:14.966364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:53:14.966373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:53:14.966378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:53:14.966555Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:53:14.834Z] "POST /anything/e2e-rt-eq-a2b99b-client HTTP/1.1" 200 - via_upstream - "-" 124 1767 132 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "6e53489e-6f4f-4404-a51b-1be0b79d0d31" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:56264 10.134.0.37:443 10.132.0.9:54190 - llm.external-model-e2e-rt-eq-a2b99b-0458c63ab9fe.2 2026-11-03T00:53:33.807580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:53:38.935670Z info ads ADS: "" 3 terminated 2026-11-03T00:53:39.033315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:53:45.962749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:55:20.090791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:55:44.290968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:57:25.702744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:57:29.439Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 42 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "15d404d1-43ba-4108-86b1-690f6eb10496" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.37:443 10.132.0.9:33138 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:58:04.915576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:58:28.346917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:59:21.966742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:59:21.966783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:59:21.966804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:59:21.966810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:59:21.783Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 183 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "fcac7e80-9556-42cd-900d-933587f4b14b" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:51670 10.134.0.37:443 10.132.0.9:37498 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:10:50.908138Z info ads ADS: new connection for node:4 2026-11-03T01:10:50.921096Z info cache read certificate from file resource=file-root:system 2026-11-03T01:19:09.910538Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T01:19:47.878327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:14.071218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:17.204185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T01:20:17.295503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:20:17.295542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:20:17.295558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:20:17.295563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T01:20:17.188Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 106 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "7ec007fb-a271-450a-a29e-018c40afae1d" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:38832 10.134.0.37:443 10.132.0.9:48162 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:20:57.131052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:31.985405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:52.811056Z info ads ADS: new connection for node:5 2026-11-03T01:21:52.811235Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:21:52.811261Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:21:55.402771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:22:18.266529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:22:35.657955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:45.968163Z info ads ADS: "" 5 terminated 2026-11-03T01:26:46.641744Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T01:29:04.851522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:06.083560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:34:49.651201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:34.844246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:23.030682Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T01:44:14.762147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:44:14.762188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:44:14.762205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:44:14.762210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T01:44:14.680Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 82 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "44f98355-b42a-44cb-85c0-fe4e48198695" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:48748 10.134.0.37:443 10.132.0.9:48414 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:44:16.738364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:44:39.522861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:14.336346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:45:17.468Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 159 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c5ca4bbe-e5c5-46e2-a2f4-5881f4cf15db" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:36902 10.134.0.37:443 10.132.0.9:58744 - v1-chat-completions-path 2026-11-03T01:45:29.410078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:31.149564Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:37.032039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:52.088732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:53.619386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:58.907291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:46:18.961754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:46:20.765030Z info ads ADS: new connection for node:6 2026-11-03T01:46:20.765338Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:46:20.765380Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:46:21.601996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:02.823490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:21.333927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:21.675144Z info ads ADS: "" 6 terminated with stream closed 2026-11-03T01:47:23.051409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:25.801047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:45.191126Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T01:47:45.294210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:49:50.686222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:03.921532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:20.022823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:31.783943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:35.171370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:46.163413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:48.017228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:50.856538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:50:50.856579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:50:50.856597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:50:50.856602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:50:51.551159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:50:51.551196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:50:51.551213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:50:51.551218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T01:50:50.795Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "dfff20a3-7462-409a-9cb8-7443ca3275ae" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:37096 10.134.0.37:443 10.132.0.9:45196 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T01:50:50.914Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 87 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "4e2f6998-b536-9622-a9a4-654823052bd9" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:51090 10.134.0.37:443 10.132.0.9:45198 - v1-completions-path [2026-11-03T01:50:51.493Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 57 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "8c2f236a-20a2-4766-8f62-21addf81b747" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:37096 10.134.0.37:443 10.132.0.9:45204 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:51:02.970172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:51:18.672375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T01:51:18.601Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 87 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "153fc97b-2989-4624-aa15-fe30042340bb" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:36564 10.134.0.37:443 10.132.0.9:39868 - v1-completions-path 2026-11-03T01:51:48.324029Z info ads ADS: new connection for node:7 2026-11-03T01:51:48.328797Z info cache read certificate from file resource=file-root:system 2026-11-03T01:51:48.792342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:51:50.097731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:51:52.701334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:51:52.701387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:51:52.701410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:51:52.701415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T01:51:52.520Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 180 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "427736ea-a380-43e7-8f39-5258966ecce5" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:34810 10.134.0.37:443 10.132.0.9:57744 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:52:10.253448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:10.253481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:10.253493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:52:10.253497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:10.253686Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T01:52:10.123Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 130 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e7be5dcb-40e7-4f44-920a-778c6a94566d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:60258 10.134.0.37:443 10.132.0.9:44782 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:52:14.619300Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:14.619333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:14.619343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:14.619348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:52:14.619534Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T01:52:14.521Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 97 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b36462ae-0ad3-4517-b39f-3f4fbe733c64" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:60258 10.134.0.37:443 10.132.0.9:44798 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:52:23.325241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:23.325299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:23.325314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:23.325318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:52:23.325515Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T01:52:23.228Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1708 96 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "4ebb36fb-e996-4dc0-b32a-d3d1dad84757" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:60258 10.134.0.37:443 10.132.0.9:52514 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:53:28.261413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:28.384928Z info ads ADS: "" 7 terminated with stream closed 2026-11-03T01:53:28.833562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:31.388982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:34.570653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:46.824503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:48.435336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:53:51.248Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 69 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c9bf2256-0ddd-410f-b85d-b06c9b14a6ad" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:36966 10.134.0.37:443 10.132.0.9:35264 - v1-completions-path 2026-11-03T01:54:03.306643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:04.864522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:07.564577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:15.946487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:21.950598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:54:21.950638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:54:21.950656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:54:21.950661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T01:54:21.888Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "105addad-f7c5-4c88-adbe-7dc2658d1bc8" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:48702 10.134.0.37:443 10.132.0.9:59326 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T01:54:23.489Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5d455d10-40d2-4386-80ff-e8b282ad33a8" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:51090 10.134.0.37:443 10.132.0.9:59342 - v1-completions-path 2026-11-03T01:54:40.346085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:50.564781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:52.220841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:54:59.762Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5fa6adf2-7865-4d7c-a023-539d32883d64" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:36966 10.134.0.37:443 10.132.0.9:49502 - v1-completions-path 2026-11-03T01:55:11.260794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:12.950474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:27.487893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:29.457119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:35.042643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:43.712952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:57.621982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:08.245039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:10.870580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:25.368496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:27.440058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:31.728153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:56:38.473Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "bffd4309-189a-45b9-adce-c80dbb6e619c" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:51090 10.134.0.37:443 10.132.0.9:46748 - v1-completions-path 2026-11-03T01:56:50.212422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:57:00.502343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:59:36.929604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:59:39.179143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:02.995664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:17.748551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:19.336768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:34.141412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:43.578432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:47.389216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:02.579602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:13.228121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:16.222986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T02:02:21.647Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "dd53f56c-205b-477d-a42f-98c1bd4f3eeb" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:51090 10.134.0.37:443 10.132.0.9:57994 - v1-completions-path 2026-11-03T02:02:33.789219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:35.856554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:38.889929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:42.528888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:02:42.528930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:02:42.528946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:02:42.528952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T02:02:42.459Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 69 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "3b69475a-c820-4366-9920-f61d798879b4" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.1.122:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:44182 10.134.0.37:443 10.132.0.9:48288 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T02:02:45.308Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "1cf76e77-4e09-4e13-9154-2185400892e8" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:36966 10.134.0.37:443 10.132.0.9:48314 - v1-completions-path 2026-11-03T02:02:48.380547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T02:02:48.380597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T02:02:48.380621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T02:02:48.380628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T02:02:47.980Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ce698b8c-e064-4a2d-a9a8-ba61a4e12937" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:51090 10.134.0.37:443 10.132.0.9:48330 - v1-completions-path [2026-11-03T02:02:48.315Z] "DELETE /v1/api-keys/2df6dabf-5de1-4021-9155-b092a817c0c5 HTTP/1.1" 200 - via_upstream - "-" 0 363 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "41cd51e3-d23f-4a38-80a4-379408e06410" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.134.1.171:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:57462 10.134.0.37:443 10.132.0.9:48342 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T02:03:00.090253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:10.436941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:13.389091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:16.010572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:20.344336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:36.896221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:47.069940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:48.660196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:55.850172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:59.154833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:04:14.803952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:04:34.696403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:04:44.881425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:04:55.159947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:05.310320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:15.542053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:25.774470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:35.962696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:46.194134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:56.450638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:06:06.585797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:06:09.317763Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T02:06:09.317790Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T02:06:09.317793Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T02:06:09.317797Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T02:06:09.294Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 23 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5427027a-3a23-4152-89ef-f87e45cdf630" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.9:60280 - v1-completions-path