2026-11-02T17:43:52.998558Z info FLAG: --concurrency="0" 2026-11-02T17:43:52.998577Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T17:43:52.998582Z info FLAG: --help="false" 2026-11-02T17:43:52.998584Z info FLAG: --log_as_json="false" 2026-11-02T17:43:52.998586Z info FLAG: --log_caller="" 2026-11-02T17:43:52.998588Z info FLAG: --log_output_level="default:info" 2026-11-02T17:43:52.998591Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T17:43:52.998595Z info FLAG: --log_target="[stdout]" 2026-11-02T17:43:52.998598Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T17:43:52.998600Z info FLAG: --outlierLogPath="" 2026-11-02T17:43:52.998602Z info FLAG: --profiling="true" 2026-11-02T17:43:52.998604Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T17:43:52.998606Z info FLAG: --proxyLogLevel="warning" 2026-11-02T17:43:52.998608Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T17:43:52.998610Z info FLAG: --stsPort="0" 2026-11-02T17:43:52.998612Z info FLAG: --templateFile="" 2026-11-02T17:43:52.998614Z info FLAG: --tokenManagerPlugin="" 2026-11-02T17:43:52.998618Z info FLAG: --vklog="0" 2026-11-02T17:43:52.998620Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T17:43:52.998768Z info Proxy role ips=[10.132.0.82] type=router id=maas-default-gateway-openshift-default-65c448b547-dtrzt.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T17:43:52.998817Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T17:43:52.999893Z info cpu limit detected as 2, setting concurrency 2026-11-02T17:43:53.000099Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T17:43:53.000110Z info JWT policy is third-party-jwt 2026-11-02T17:43:53.000113Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T17:43:53.002727Z info Starting default Istio SDS Server 2026-11-02T17:43:53.002818Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T17:43:53.002898Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T17:43:53.002758Z info Opening status port 15020 2026-11-02T17:43:53.003542Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T17:43:53.005362Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T17:43:53.006541Z info Starting proxy agent 2026-11-02T17:43:53.006624Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T17:43:53.014106Z info sds Starting SDS grpc server 2026-11-02T17:43:53.014131Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T17:43:53.084268Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T17:43:53.136984Z info cache generated new workload certificate resourceName=default latency=133.25937ms ttl=23h59m59.863021819s 2026-11-02T17:43:53.137031Z info cache Root cert has changed, start rotating root cert 2026-11-02T17:43:53.137071Z info cache returned workload trust anchor from cache ttl=23h59m59.862929996s 2026-11-02T17:43:53.230360Z info ads ADS: new connection for node:1 2026-11-02T17:43:53.236578Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T17:43:53.236631Z info cache read certificate from file resource=file-root:system 2026-11-02T17:43:53.260782Z info ads ADS: new connection for node:2 2026-11-02T17:43:53.260863Z info cache returned workload certificate from cache ttl=23h59m59.739139175s 2026-11-02T17:43:53.261710Z info ads ADS: new connection for node:3 2026-11-02T17:43:53.261776Z info cache returned workload trust anchor from cache ttl=23h59m59.738225446s 2026-11-02T17:43:53.365652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:43:57.873192Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-11-02T17:44:02.315225Z info Readiness succeeded in 9.319317919s 2026-11-02T17:44:02.315724Z info Envoy proxy is ready 2026-11-02T17:44:08.637362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:44:33.955013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:44:44.265642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:44:59.126372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:44:59.126412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:44:59.126427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T17:44:59.126432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T17:44:59.024Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 101 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "0db15917-bc68-4514-91f8-ebd1946e4be6" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:52692 10.132.0.82:443 10.132.0.15:36136 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T17:44:59.732791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:44:59.732827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:44:59.732856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T17:44:59.732861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:44:59.733048Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T17:44:59.596Z] "POST /anything/e2e-rt-eq-b76f7a-client HTTP/1.1" 200 - via_upstream - "-" 124 1762 136 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "27c379fc-f7ff-49a1-b39d-ea61782f2246" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.82:35696 10.132.0.82:443 10.132.0.15:36150 - llm.external-model-e2e-rt-eq-b76f7a-c2af0e331308.2 2026-11-02T17:45:04.837207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:45:04.837240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:45:04.837251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T17:45:04.837255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:45:04.837429Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T17:45:04.642Z] "POST /anything/e2e-rt-eq-b76f7a-client HTTP/1.1" 200 - via_upstream - "-" 124 1761 195 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2544d66b-def4-466a-99b4-971bdc74dc1d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.82:49948 10.132.0.82:443 10.132.0.15:37650 - llm.external-model-e2e-rt-eq-b76f7a-c2af0e331308.0 2026-11-02T17:45:24.279061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:45:30.420044Z info ads ADS: "" 1 terminated with stream closed 2026-11-02T17:45:30.480554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:45:40.925942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:46:11.711053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:46:28.114499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:47:45.819495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:48:13.069263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T17:48:12.314Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 411 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "4017277f-9da6-42d3-860d-00ef4f8d20bc" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.82:443 10.132.0.15:39806 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T17:48:20.626965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:48:20.627022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:48:20.627039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:48:20.627044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T17:48:20.556Z] "DELETE /v1/api-keys/f66b7020-7571-4dd0-ad6a-b08a3bfa4a4f HTTP/1.1" 200 - via_upstream - "-" 0 321 70 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "ca95e25f-256b-44f3-8629-1d878a0f8552" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:52084 10.132.0.82:443 10.132.0.15:50492 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T17:48:21.353946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:48:21.353982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:48:21.353998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T17:48:21.354003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T17:48:21.283Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 70 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c69cd1a9-b8f6-4350-b4e8-197dec77a7b0" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:52086 10.132.0.82:443 10.132.0.15:50502 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T17:48:35.744600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:48:56.147183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:53:13.628939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:53:13.628975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:53:13.628987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:53:13.628992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T17:53:13.629165Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-02T17:53:13.629221Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T17:53:13.629229Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T17:53:13.629232Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T17:53:13.629236Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T17:53:13.533Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 95 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "393631ba-1fc7-4db7-b646-2f095d99e738" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:46760 10.132.0.82:443 10.132.0.15:41054 - v1-completions-path [2026-11-02T17:54:16.286Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 327 75 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "61f3a7a6-1037-4a81-93d3-3c2229aeb8bb" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:46760 10.132.0.82:443 10.132.0.15:47180 - v1-chat-completions-path 2026-11-02T18:02:30.808456Z info ads ADS: new connection for node:4 2026-11-02T18:02:30.891091Z info cache read certificate from file resource=file-root:system 2026-11-02T18:09:43.432067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:09:59.205918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:10:03.150502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T18:10:03.150707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:10:03.150773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:10:03.150828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:10:03.150893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T18:10:01.011Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 2139 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "a6cc4e69-d3d7-416b-9151-2381e265e18a" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:40544 10.132.0.82:443 10.132.0.15:55272 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T18:10:08.352Z] "POST /llm/e2e-dft-b1952b/anything/e2e-dft-b1952b-5bf704 HTTP/1.1" 403 - - "-" 109 77 44 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "b2792902-9368-46b7-a265-d18a16b1b72a" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-b1952b.llm.svc.cluster.local - 10.132.0.82:443 10.132.0.15:55458 - llm.external-model-e2e-dft-b1952b-a55676dbae77.2 2026-11-02T18:10:36.534775Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:11:36.899187Z info ads ADS: new connection for node:5 2026-11-02T18:11:36.899680Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T18:11:36.902992Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T18:11:41.728700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:12:40.701488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:12:50.607885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:12:50.607922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:12:50.607934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:12:50.607938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T18:12:50.608128Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T18:12:50.389Z] "POST /anything/e2e-dft-8c568a-00d8e5 HTTP/1.1" 200 - via_upstream - "-" 109 1763 219 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "dca93a9a-5b0c-4048-8795-1505fe41f8fe" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.82:46394 10.132.0.82:443 10.132.0.15:51912 - llm.external-model-e2e-dft-8c568a-509ece9bc93d.0 2026-11-02T18:13:40.043309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:14:29.674419Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T18:15:03.850585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:15:08.226Z] "POST /llm/e2e-dft-32beb1/anything/e2e-dft-32beb1-c70e40 HTTP/1.1" 403 - - "-" 109 77 174 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "bc378d68-50c5-40c0-8c8e-78b81555ebc9" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-32beb1.llm.svc.cluster.local - 10.132.0.82:443 10.132.0.15:57166 - llm.external-model-e2e-dft-32beb1-8faa743806da.2 2026-11-02T18:15:26.236196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:16:02.571511Z info ads ADS: "" 5 terminated 2026-11-02T18:16:19.850629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:19:22.958197Z info ads ADS: "" 4 terminated with stream closed 2026-11-02T18:22:35.225420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:24:30.209300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:24:51.546494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:26:38.435660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:32:34.662988Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-02T18:34:51.573326Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T18:36:10.981879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:36:33.392934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:36:44.826708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:36:44.826745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:36:44.826753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T18:36:44.826764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:36:44.826770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T18:36:44.763Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 63 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "3e1bc2f2-f0fb-4917-9f0d-d68351631723" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:37034 10.132.0.82:443 10.132.0.15:52190 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T18:37:05.151243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:37:20.966833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:37:22.570499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:37:28.031928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:37:43.266141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:37:44.959333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:37:59.098781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:38:09.906933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:38:11.633148Z info ads ADS: new connection for node:6 2026-11-02T18:38:11.633648Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T18:38:11.633754Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T18:38:13.045164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:38:53.578583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:39:12.187177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:39:12.618185Z info ads ADS: "" 6 terminated with stream closed 2026-11-02T18:39:14.005238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:39:16.392462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:39:20.728131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:41:28.431583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:41:28.431633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:41:28.431657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T18:41:28.431663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T18:41:28.362Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 69 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "73c272b5-2bbc-4767-8e25-d7edb0f44244" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:34632 10.132.0.82:443 10.132.0.15:41716 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T18:41:33.198974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:41:49.787917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:42:06.046632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:42:17.749684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:42:20.881361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:42:29.856254Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:42:32.071705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:42:32.804812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:42:32.804888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:42:32.804916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:42:32.804924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T18:42:32.703Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 101 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "eee99f17-53b3-4f1d-be66-7ce1d5de549e" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:41068 10.132.0.82:443 10.132.0.15:37328 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T18:42:47.060231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:42:48.470Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 75 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "1bc7c074-34c4-449f-ba48-d3b8137331b8" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:36878 10.132.0.82:443 10.132.0.15:53506 - v1-completions-path 2026-11-02T18:43:31.255102Z info ads ADS: new connection for node:7 2026-11-02T18:43:31.262569Z info cache read certificate from file resource=file-root:system 2026-11-02T18:43:31.695977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:43:33.268528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:44:09.068992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:44:09.069027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:44:09.069038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T18:44:09.069042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:44:09.069221Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T18:44:08.942Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1708 127 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "702cd233-d297-48cc-a5c2-5711c84f1564" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.82:39172 10.132.0.82:443 10.132.0.15:58088 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T18:44:31.059260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:44:31.059299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:44:31.059313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T18:44:31.059317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:44:31.059520Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T18:44:30.927Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 132 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "e1f1a87b-d943-4abf-a937-79b82419cbd1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.82:45052 10.132.0.82:443 10.132.0.15:39596 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T18:44:33.214290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:44:33.214328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:44:33.214341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:44:33.214345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T18:44:33.214537Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T18:44:33.112Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 101 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "089b0190-aa5d-43b0-875a-7665bd40a2ce" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.82:45052 10.132.0.82:443 10.132.0.15:47506 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T18:45:01.470389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:45:01.470422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:45:01.470434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T18:45:01.470439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:45:01.470623Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T18:45:01.364Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 106 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "f81f2440-ac8d-4c9d-99b1-bada5c42f56f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.82:45052 10.132.0.82:443 10.132.0.15:46014 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T18:45:07.957688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:45:07.957727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:45:07.957739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:45:07.957743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T18:45:07.957997Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T18:45:07.855Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 103 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "bd0c5cd1-5d8e-44cd-9af1-139d81e26049" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.82:45052 10.132.0.82:443 10.132.0.15:51050 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T18:45:23.132443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:45:23.260873Z info ads ADS: "" 7 terminated with stream closed 2026-11-02T18:45:23.726883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:45:26.319939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:45:28.555232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:45:31.949Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 83 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "10bfd5cf-3312-478b-a3bf-034221d5a601" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:38890 10.132.0.82:443 10.132.0.15:54394 - v1-completions-path 2026-11-02T18:45:44.200433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:45:45.788069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:45:48.690Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "dde4390e-0ef6-40f0-87dc-52dbc7a77ab7" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.82:443 10.132.0.15:44444 - v1-completions-path 2026-11-02T18:46:00.407253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:46:02.094889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:46:05.041589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:46:13.160579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:46:16.478Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 66 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "776e081c-23e0-42ef-96c6-f54265c904f0" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:59380 10.132.0.82:443 10.132.0.15:51396 - v1-completions-path [2026-11-02T18:46:17.881Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2821d4e0-780d-458c-b00b-afdc7dbfa1ec" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:38890 10.132.0.82:443 10.132.0.15:51402 - v1-completions-path 2026-11-02T18:46:34.406885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:46:44.618927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:46:46.785271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:46:51.931136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:46:51.931176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:46:51.931196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T18:46:51.931201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T18:46:51.858Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 72 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "9ba71caa-b01f-4d9f-975b-711add9cca40" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:39292 10.132.0.82:443 10.132.0.15:39812 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T18:47:05.354250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:47:06.976188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:47:12.358035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:47:23.351497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:47:36.977784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:47:38.551555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:47:43.897208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:48:02.215560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:48:04.927877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:48:18.848025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:48:20.627236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:48:22.074Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 39 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "7df29a38-50cb-4c3e-91d9-207be442fd6b" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.82:443 10.132.0.15:35044 - v1-completions-path 2026-11-02T18:48:26.296606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:48:41.341866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:48:51.513932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:49:06.885319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:49:09.215537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:51:22.245590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:51:24.627138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:52:49.024657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:53:04.041243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:53:05.567388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:53:11.409920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:53:30.201097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:53:34.001533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:53:37.138Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "9a4dd6da-0734-49fe-9a4a-36f66be78cc7" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:38890 10.132.0.82:443 10.132.0.15:56836 - v1-completions-path 2026-11-02T18:53:49.217669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:53:59.633460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:54:02.688966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:54:06.551Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 66 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c61017f9-dbc8-4aeb-9879-13147f11f265" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:38890 10.132.0.82:443 10.132.0.15:50224 - v1-completions-path 2026-11-02T18:54:08.117292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:54:08.117331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T18:54:08.117347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T18:54:08.117352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T18:54:08.054Z] "DELETE /v1/api-keys/75c60720-d29f-41ef-86b5-03312572ae37 HTTP/1.1" 200 - via_upstream - "-" 0 365 63 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c0ac5916-0168-4290-952d-6cc6b0861e56" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.132.1.153:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:36718 10.132.0.82:443 10.132.0.15:50232 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T18:54:19.536369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:54:21.777288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:54:25.156006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:54:29.965Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "80ec1de0-1074-4016-a83d-ac1d2f1ff07c" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:38890 10.132.0.82:443 10.132.0.15:58608 - v1-completions-path [2026-11-02T18:54:32.605Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "b0d1d9e6-6745-447f-ae61-c8438e3a59e4" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.82:38890 10.132.0.82:443 10.132.0.15:58610 - v1-completions-path 2026-11-02T18:54:47.132022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:54:57.287919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:54:59.304206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:55:02.539379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:55:07.819332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:55:23.999602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:55:34.166009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:55:35.717684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:55:43.027387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:55:45.913770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:55:49.143336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:56:05.108946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:56:25.030219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:56:35.251201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:56:45.533412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:56:55.707968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:57:05.882357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:57:16.196458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:57:26.306438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:57:36.575498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:57:46.771496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:57:57.010820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:57:58.848499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:57:58.848544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T18:57:58.848569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T18:57:58.848575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T18:57:58.711Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 136 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "914df114-24ee-4952-9904-7ce45aa4b750" "maas.apps.0069df05874e3f91ac88.prod.konflux-ocp-ci.dev" "10.133.1.97:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.82:49054 10.132.0.82:443 10.132.0.15:56110 - odh-ai-gateway-infra.maas-api-route.3