2026-11-02T14:48:11.237534Z info FLAG: --concurrency="0" 2026-11-02T14:48:11.237555Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T14:48:11.237561Z info FLAG: --help="false" 2026-11-02T14:48:11.237564Z info FLAG: --log_as_json="false" 2026-11-02T14:48:11.237566Z info FLAG: --log_caller="" 2026-11-02T14:48:11.237568Z info FLAG: --log_output_level="default:info" 2026-11-02T14:48:11.237570Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T14:48:11.237575Z info FLAG: --log_target="[stdout]" 2026-11-02T14:48:11.237577Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T14:48:11.237579Z info FLAG: --outlierLogPath="" 2026-11-02T14:48:11.237581Z info FLAG: --profiling="true" 2026-11-02T14:48:11.237584Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T14:48:11.237586Z info FLAG: --proxyLogLevel="warning" 2026-11-02T14:48:11.237588Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T14:48:11.237590Z info FLAG: --stsPort="0" 2026-11-02T14:48:11.237592Z info FLAG: --templateFile="" 2026-11-02T14:48:11.237594Z info FLAG: --tokenManagerPlugin="" 2026-11-02T14:48:11.237597Z info FLAG: --vklog="0" 2026-11-02T14:48:11.237600Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T14:48:11.237769Z info Proxy role ips=[10.134.0.163] type=router id=maas-default-gateway-openshift-default-6886b96f9-lfj9p.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T14:48:11.237820Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T14:48:11.239491Z info cpu limit detected as 2, setting concurrency 2026-11-02T14:48:11.240201Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T14:48:11.240225Z info JWT policy is third-party-jwt 2026-11-02T14:48:11.240237Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T14:48:11.242964Z info Opening status port 15020 2026-11-02T14:48:11.242984Z info Starting default Istio SDS Server 2026-11-02T14:48:11.243015Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T14:48:11.243038Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T14:48:11.243741Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T14:48:11.245564Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T14:48:11.246435Z info Starting proxy agent 2026-11-02T14:48:11.246471Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T14:48:11.262080Z info sds Starting SDS grpc server 2026-11-02T14:48:11.262123Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T14:48:11.305141Z info cache generated new workload certificate resourceName=default latency=61.23241ms ttl=23h59m59.694863205s 2026-11-02T14:48:11.305184Z info cache Root cert has changed, start rotating root cert 2026-11-02T14:48:11.305229Z info cache returned workload trust anchor from cache ttl=23h59m59.694771874s 2026-11-02T14:48:11.317306Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T14:48:11.581166Z info ads ADS: new connection for node:1 2026-11-02T14:48:11.581250Z info cache returned workload certificate from cache ttl=23h59m59.418751871s 2026-11-02T14:48:11.581824Z info ads ADS: new connection for node:2 2026-11-02T14:48:11.582099Z info cache returned workload trust anchor from cache ttl=23h59m59.417903992s 2026-11-02T14:48:11.695554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T14:48:20.093675Z info Readiness succeeded in 8.858697702s 2026-11-02T14:48:20.094235Z info Envoy proxy is ready 2026-11-02T14:49:37.208714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T14:50:09.672930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T14:51:35.511739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T14:51:36.534773Z warn xdsproxy downstream terminated with unexpected error send error for type url type.googleapis.com/envoy.config.route.v3.RouteConfiguration: rpc error: code = Canceled desc = context canceled id=1 2026-11-02T14:51:38.240832Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T15:00:01.886504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:00:24.045251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:00:56.530693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:01:12.575652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:01:15.912170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T15:01:16.471Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 117 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e2b1f984-56e5-4537-b3d5-8eb1cdf60335" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.163:443 10.132.0.19:37732 - v1-catch-all-path 2026-11-02T15:01:18.988642Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T15:01:18.890Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 97 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "74dfa3b0-db96-4e38-8985-b4158a2e452d" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.27:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:41792 10.134.0.163:443 10.132.0.19:43358 - v1-catch-all-model-routing 2026-11-02T15:01:22.326722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T15:01:26.128Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 66 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "cd9852a1-3be4-4bf1-9cbd-9ef2201750e3" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.163:443 10.132.0.19:43386 - v1-catch-all-path 2026-11-02T15:01:29.751480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:01:39.526961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:01:54.548994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:02:05.507172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:02:07.279581Z info ads ADS: new connection for node:3 2026-11-02T15:02:07.279868Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T15:02:07.279926Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T15:02:08.070157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:02:49.855020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:02:52.595110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:02:52.595169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:02:52.595193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:02:52.595201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:02:50.667Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 1928 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d111bf28-e8d3-4cd4-90ba-af32d2dbdede" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.163:36670 10.134.0.163:443 10.132.0.19:43826 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:03:08.988698Z info ads ADS: "" 3 terminated 2026-11-02T15:03:09.037501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:03:11.394522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:03:11.394562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:03:11.394577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:03:11.394582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T15:03:11.319Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 332 75 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8803916e-36e5-4161-81d8-1df84c894be5" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.163:36670 10.134.0.163:443 10.132.0.19:40678 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:03:12.427965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:03:20.879400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:05:47.515579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:05:47.515618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:05:47.515633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:05:47.515638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:05:47.430Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 326 84 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d1f49670-5517-4fb9-8494-bfe282e7be17" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.163:35566 10.134.0.163:443 10.132.0.19:52534 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:05:52.923132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:06:09.183207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:06:25.014164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:06:36.869757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:06:41.231903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:06:52.510070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:07:05.914707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T15:07:08.977Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 80 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e5d8d263-d3d2-407e-a03c-09e2fd331097" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:59370 - v1-completions-path 2026-11-02T15:07:21.338997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:08:17.462385Z info ads ADS: new connection for node:4 2026-11-02T15:08:17.467913Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T15:08:17.468098Z info cache read certificate from file resource=file-root:system 2026-11-02T15:08:18.538444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:08:20.094449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:08:31.584534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T15:08:31.684442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:31.684479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:31.684490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:08:31.684495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:31.684648Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:08:31.573Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 111 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e70dac07-8c62-4709-9e99-f3a19c9a7bf7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.163:40262 10.134.0.163:443 10.132.0.19:57322 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:08:50.903132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:08:50.903168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:08:50.903183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:08:50.903189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T15:08:50.903380Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T15:08:50.783Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 119 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "61bf3ed0-b733-48c4-acb8-79c63bf3c320" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.163:43010 10.134.0.163:443 10.132.0.19:57054 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:08:55.156485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:55.156535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:55.156552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:08:55.156559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:55.156822Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:08:55.051Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1711 105 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "be98a904-d06c-4bb5-84bc-b0e2be8dfdef" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.163:40262 10.134.0.163:443 10.132.0.19:57080 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:03.669192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:03.669227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:03.669239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:03.669243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:09:03.669404Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:09:03.562Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1705 107 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "7b69415b-cb9f-40d0-8a2a-bc97f3343ca4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.163:40262 10.134.0.163:443 10.132.0.19:51858 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:10.093845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:10.093882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:10.093894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:10.093898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:09:10.094134Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:09:09.985Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 108 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "62fce744-fcc2-4cb7-bef1-1114d387140e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.163:40262 10.134.0.163:443 10.132.0.19:47866 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:33.474384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:33.474431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:33.474448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:33.474455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:09:33.474673Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:09:33.374Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1705 99 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "330539df-1d9a-49e7-ad8a-065588f7563b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.163:40262 10.134.0.163:443 10.132.0.19:41506 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:55.899164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:09:55.899202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:09:55.899217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:09:55.899222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:09:55.819Z] "DELETE /v1/api-keys/c3ffe7ee-a657-4e9f-a598-180d05473fd8 HTTP/1.1" 200 - via_upstream - "-" 0 359 79 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e25f4915-1a57-4c5c-b0f9-a3b5ee57b060" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.163:55080 10.134.0.163:443 10.132.0.19:33490 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:10:07.521486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:10:07.609698Z info ads ADS: "" 4 terminated 2026-11-02T15:10:09.016420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:10:14.325846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:10:17.323568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:10:17.323606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:10:17.323620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:10:17.323625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:10:17.243Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 80 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "30b276d3-e32b-4a24-a3dc-e332176533ac" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.163:55080 10.134.0.163:443 10.132.0.19:51148 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:10:17.549Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "9ed6e072-6779-4bc2-b27d-045fa85e208a" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:34328 - v1-completions-path 2026-11-02T15:10:18.324802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T15:10:18.320Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "3b49261e-300c-470e-8b89-001ba457bb76" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.163:443 10.132.0.19:34332 - v1-completions-path 2026-11-02T15:10:30.352568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:10:34.981690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T15:10:49.344Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 93 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b82059a5-9961-42a7-a88d-e16397d63ec1" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:48594 10.134.0.163:443 10.132.0.19:46512 - v1-completions-path 2026-11-02T15:10:50.264439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:11:05.918907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T15:11:12.321Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8493a2c7-b335-4074-9681-36a078baa125" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:44862 - v1-completions-path [2026-11-02T15:11:12.878Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d7f9090d-c7fc-4103-b6fb-6f5d9eac23bd" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:48622 10.134.0.163:443 10.132.0.19:44872 - v1-completions-path [2026-11-02T15:11:13.033Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "92f9b711-ef81-4888-a17f-9c405a513b25" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:44880 - v1-completions-path [2026-11-02T15:11:13.704Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "ca0671aa-f8c1-45a1-bb27-d0565d2c625b" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:48622 10.134.0.163:443 10.132.0.19:44900 - v1-completions-path 2026-11-02T15:11:29.094382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:11:39.382827Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:11:44.079131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T15:11:50.742Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "237b3aff-52e1-4437-8d2e-6fbfe8241e7b" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:37336 - v1-completions-path [2026-11-02T15:11:50.822Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "f4addcf1-87d6-489e-809f-2a11b1e7dc9e" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:37344 - v1-completions-path [2026-11-02T15:11:51.315Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "eee17dde-7dad-499a-85a4-e807fcddf999" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:37354 - v1-completions-path 2026-11-02T15:12:03.898919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:12:06.292520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:12:13.950088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:12:23.472527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:12:29.076232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:12:37.141140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:12:42.683677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:13:00.634745Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:13:03.879714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:13:19.679712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:13:22.709150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:13:30.802923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T15:13:36.069Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "890bf8b4-65ae-4a43-aacc-f6fe62b76e81" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:33458 - v1-completions-path 2026-11-02T15:13:48.303395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:13:58.569278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:14:04.493505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:14:12.419218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:16:57.767656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:17:00.571837Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:18:26.844393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:18:44.482629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:18:46.811815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:18:47.526006Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:18:47.526039Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:18:47.526043Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:18:47.526049Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T15:18:47.470Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 55 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "a3f6fc16-41f7-4e06-9b7e-09753741f945" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.163:443 10.132.0.19:59282 - v1-completions-path 2026-11-02T15:18:54.253252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:19:21.034317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:19:24.248848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T15:19:27.327Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 71 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "c6bcb4e6-aa5f-4ef6-b763-25ae8e6761d8" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:48622 10.134.0.163:443 10.132.0.19:40922 - v1-completions-path 2026-11-02T15:19:39.949700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:19:50.215745Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:19:54.795348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:19:58.490271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:58.490308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:58.490322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:19:58.490327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:58.581773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:58.581812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:58.581837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:58.581842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:19:58.406Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 83 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "edcf22e3-56d3-4b33-ab2f-23ee21b21b1b" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.172:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.163:34080 10.134.0.163:443 10.132.0.19:53002 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:19:58.511Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 70 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "786b8eb0-f756-4f34-9f22-b794dfc27f9c" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.172:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.163:34080 10.134.0.163:443 10.132.0.19:53012 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:19:59.141Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "3ee4745e-8709-4fda-8a62-c87563142c8f" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:53318 10.134.0.163:443 10.132.0.19:53016 - v1-completions-path [2026-11-02T15:19:59.506Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "17a79853-3002-4b70-a691-3da2b92341e9" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.163:443 10.132.0.19:53032 - v1-completions-path 2026-11-02T15:20:11.782305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:20:16.244135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:20:20.170730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:20:25.600515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:20:25.600555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:20:25.600571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:20:25.600577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:20:25.515Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 84 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b5040628-5e84-40da-b8dd-d8f0a8034e0f" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.1.97:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.163:35988 10.134.0.163:443 10.132.0.19:34798 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:20:30.020Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8f3e899a-4f8e-4659-bc74-58ae60d03dd8" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.163:48622 10.134.0.163:443 10.132.0.19:35380 - v1-completions-path 2026-11-02T15:20:42.553492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:20:52.747642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:20:57.386869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:21:01.166211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:21:06.258058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:21:24.444875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:21:34.691039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:21:36.989989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:21:49.436963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:21:52.793426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:22:10.835219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:22:13.203657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:22:31.573538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:22:41.921625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:22:52.222359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:23:02.505548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:23:12.851834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:23:21.441670Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T15:23:23.044013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:23:33.396764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:23:43.757449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:23:54.072511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:24:04.356802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T15:24:11.358240Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:24:11.358268Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:24:11.358271Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:24:11.358276Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T15:24:11.333Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 24 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "810984cd-c178-4402-98c1-526e9461978e" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.163:443 10.132.0.19:52082 - v1-completions-path [2026-11-02T15:24:13.754Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 42 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "a63fad7a-b571-46f4-ac18-d9ad02fe98a2" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.163:443 10.132.0.19:52096 - v1-completions-path