2026-11-03T21:48:19.983060Z info FLAG: --concurrency="0" 2026-11-03T21:48:19.983097Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T21:48:19.983104Z info FLAG: --help="false" 2026-11-03T21:48:19.983107Z info FLAG: --log_as_json="false" 2026-11-03T21:48:19.983110Z info FLAG: --log_caller="" 2026-11-03T21:48:19.983113Z info FLAG: --log_output_level="default:info" 2026-11-03T21:48:19.983117Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T21:48:19.983123Z info FLAG: --log_target="[stdout]" 2026-11-03T21:48:19.983126Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T21:48:19.983129Z info FLAG: --outlierLogPath="" 2026-11-03T21:48:19.983132Z info FLAG: --profiling="true" 2026-11-03T21:48:19.983135Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T21:48:19.983138Z info FLAG: --proxyLogLevel="warning" 2026-11-03T21:48:19.983141Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T21:48:19.983145Z info FLAG: --stsPort="0" 2026-11-03T21:48:19.983148Z info FLAG: --templateFile="" 2026-11-03T21:48:19.983151Z info FLAG: --tokenManagerPlugin="" 2026-11-03T21:48:19.983155Z info FLAG: --vklog="0" 2026-11-03T21:48:19.983159Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T21:48:19.983349Z info Proxy role ips=[10.134.0.179] type=router id=maas-default-gateway-openshift-default-8b9c49cd7-n5nd4.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T21:48:19.983422Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T21:48:19.984616Z info cpu limit detected as 2, setting concurrency 2026-11-03T21:48:19.984835Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T21:48:19.984849Z info JWT policy is third-party-jwt 2026-11-03T21:48:19.984853Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T21:48:19.986380Z info Starting default Istio SDS Server 2026-11-03T21:48:19.986403Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T21:48:19.986420Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T21:48:19.986526Z info Opening status port 15020 2026-11-03T21:48:19.987962Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T21:48:19.989338Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T21:48:19.990098Z info Starting proxy agent 2026-11-03T21:48:19.990129Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T21:48:19.998718Z info sds Starting SDS grpc server 2026-11-03T21:48:19.998739Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T21:48:20.069420Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T21:48:20.264462Z info cache generated new workload certificate resourceName=default latency=276.021902ms ttl=23h59m59.735543183s 2026-11-03T21:48:20.264499Z info cache Root cert has changed, start rotating root cert 2026-11-03T21:48:20.264536Z info cache returned workload trust anchor from cache ttl=23h59m59.735464984s 2026-11-03T21:48:20.351380Z info ads ADS: new connection for node:1 2026-11-03T21:48:20.355981Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T21:48:20.356039Z info cache read certificate from file resource=file-root:system 2026-11-03T21:48:20.384480Z info ads ADS: new connection for node:2 2026-11-03T21:48:20.384562Z info cache returned workload certificate from cache ttl=23h59m59.615440926s 2026-11-03T21:48:20.385033Z info ads ADS: new connection for node:3 2026-11-03T21:48:20.385126Z info cache returned workload trust anchor from cache ttl=23h59m59.614875396s 2026-11-03T21:48:20.480970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:48:29.551488Z info Readiness succeeded in 9.571045659s 2026-11-03T21:48:29.551865Z info Envoy proxy is ready 2026-11-03T21:48:29.945101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:48:40.626264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:48:40.626392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:48:40.626517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:48:40.626559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:48:40.626881Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T21:48:40.325Z] "POST /anything/e2e-dft-c9c3d4-7fa79f HTTP/1.1" 200 - via_upstream - "-" 109 1587 301 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "2bb0f93b-5ea2-48e0-8c04-6626ea93ed73" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.179:48568 10.134.0.179:443 10.132.0.21:52714 - llm.external-model-e2e-dft-c9c3d4-41977e8fa45c.0 2026-11-03T21:48:45.227689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T21:48:45.227721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T21:48:45.227730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T21:48:45.227734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T21:48:45.227898Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T21:48:41.993Z] "POST /anything/e2e-dft-c9c3d4-7fa79f HTTP/1.1" 200 - via_upstream - "-" 109 1595 3234 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c77403e1-cdec-4ca2-95f7-49f00da44864" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.179:60864 10.134.0.179:443 10.132.0.21:52724 - llm.external-model-e2e-dft-c9c3d4-41977e8fa45c.0 2026-11-03T21:48:54.931573Z info ads ADS: "" 1 terminated with stream closed 2026-11-03T21:48:57.035241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:48:58.082749Z info ads ADS: new connection for node:4 2026-11-03T21:48:58.104629Z info cache read certificate from file resource=file-root:system 2026-11-03T21:49:01.269672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:03.577000Z info ads ADS: "" 4 terminated 2026-11-03T21:49:07.655508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:10.211647Z info ads ADS: new connection for node:5 2026-11-03T21:49:10.256517Z info cache read certificate from file resource=file-root:system 2026-11-03T21:49:11.587313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:14.453693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:17.076518Z info ads ADS: "" 5 terminated with stream closed 2026-11-03T21:49:18.266264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:59.938201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:30.420379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:56:11.999327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:58:10.001058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:11:09.377005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:11:39.457199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:12:16.013068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:12:35.339892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:12:40.316263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:12:48.821816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:03.192640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:12.257433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:29.322804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:41.003526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:44.607918Z info ads ADS: new connection for node:6 2026-11-03T22:13:44.608105Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T22:13:44.608171Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T22:13:48.008631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:14:26.925163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:14:33.034Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 333 88 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "5a4d49bc-d4d2-4ea0-bbd7-640203f6b8f1" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.133.1.103:8000" outbound|54321||e2e-prio-pool-afdcb5ab-inference-pool-ip-3f1dbe2d.llm.svc.cluster.local 10.134.0.179:58064 10.134.0.179:443 10.132.0.21:59146 - v1-model-routing [2026-11-03T22:14:36.622Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 345 61 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "5a71ed8c-dfc5-4562-a590-f92a9ec33770" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.133.1.103:8000" outbound|54321||e2e-prio-pool-afdcb5ab-inference-pool-ip-3f1dbe2d.llm.svc.cluster.local 10.134.0.179:58078 10.134.0.179:443 10.132.0.21:46390 - v1-model-routing 2026-11-03T22:14:51.975390Z info ads ADS: "" 6 terminated 2026-11-03T22:14:52.034507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:14:56.446360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:15:13.173645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:16:14.020547Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T22:18:00.388525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:18:30.151325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:18:57.931936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:18:57.931979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:18:57.931997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:18:57.932004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T22:18:57.813Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 118 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a9411210-6280-4e6d-8579-d64eac682a9b" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.179:42608 10.134.0.179:443 10.132.0.21:54088 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:19:00.564104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:16.144759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:31.267113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:43.738783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:48.852699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:53.814037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-03T22:19:53.755Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 74 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "2a00fbfc-1846-4e03-9605-b07b2a9bff29" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:34062 10.134.0.179:443 10.132.0.21:42990 - v1-completions-path [2026-11-03T22:19:55.402Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 52 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "01f74811-d5a0-491a-b4a8-87e289d8d80a" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.179:443 10.132.0.21:43000 - v1-completions-path [2026-11-03T22:19:55.667Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f312d3ef-7674-465d-8a6d-8998749e7c41" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.179:443 10.132.0.21:43010 - v1-completions-path 2026-11-03T22:20:09.701971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:20:57.368779Z info ads ADS: new connection for node:7 2026-11-03T22:20:57.375591Z info cache read certificate from file resource=file-root:system 2026-11-03T22:21:01.267226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:21:02.392032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:21:10.231680Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"548","StreamId":"1844405573963841413"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=26 [2026-11-03T22:21:10.168Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 63 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "da6a201f-3742-4f70-a263-c0f9301c22ba" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.179:443 10.132.0.21:51390 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T22:21:12.501276Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"552","StreamId":"96205250027016328"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-03T22:21:12.443Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "38602ace-0496-4f32-b3a9-dea6076e752f" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.179:443 10.132.0.21:51410 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T22:21:50.519324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T22:21:50.659955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:50.659989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:50.660000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:50.660005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:21:50.660209Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T22:21:50.463Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1539 197 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "5100071e-f93c-4b26-80f4-8386131f7809" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.179:34392 10.134.0.179:443 10.132.0.21:34124 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:21:57.790596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:57.790627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:57.790636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:57.790641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:21:57.790786Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T22:21:57.663Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1534 127 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "beeaa5cc-191e-45b6-95d4-34fea1e138cd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.179:34392 10.134.0.179:443 10.132.0.21:38298 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:14.271051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:22:14.271133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:22:14.271153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:22:14.271160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T22:22:14.271434Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T22:22:14.053Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1533 217 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "63b84e7f-c086-45ec-9615-625c41be4655" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.179:44108 10.134.0.179:443 10.132.0.21:58630 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:42.354293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:22:42.354325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:22:42.354335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:22:42.354339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T22:22:42.354494Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T22:22:42.220Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1537 133 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "954e81fe-c08e-48a8-baad-6f2a8928290e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.179:44108 10.134.0.179:443 10.132.0.21:41430 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:57.798590Z info ads ADS: "" 7 terminated with stream closed 2026-11-03T22:22:59.470733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:23:00.473677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:23:11.213379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:23:11.983Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 1866 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c33d86f2-78fb-470e-9080-79dd0b33d59a" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:53882 10.134.0.179:443 10.132.0.21:41198 - v1-completions-path 2026-11-03T22:23:29.677377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:23:34.321907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:23:39.854Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b0a906f3-24ff-4452-a971-16bc290a76ec" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:34062 10.134.0.179:443 10.132.0.21:58550 - v1-completions-path [2026-11-03T22:23:53.567Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 85 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "e436bf85-48ed-4717-a8e7-1cd870685f46" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:35344 10.134.0.179:443 10.132.0.21:60254 - v1-completions-path 2026-11-03T22:23:58.886062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:24:12.024750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:24:22.967Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "060f3f5d-74c8-4da6-b1f8-1cde8bbaee0f" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:53882 10.134.0.179:443 10.132.0.21:38694 - v1-completions-path 2026-11-03T22:24:42.639639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:24:53.253109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:24:59.771230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:25:10.654Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "2c3a4e14-651c-4c20-b001-332d253344a2" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:53882 10.134.0.179:443 10.132.0.21:51550 - v1-completions-path [2026-11-03T22:25:11.431Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a6100ff4-723d-40a2-a6b8-32921fad5e19" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:34062 10.134.0.179:443 10.132.0.21:51564 - v1-completions-path 2026-11-03T22:25:28.113093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:25:32.916288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:25:46.542408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:25:55.728158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:06.334775Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:12.820145Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:27.773044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:39.812762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:44.826530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:26:47.710Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 69 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "9f9f2857-1c04-4209-bacf-e8e925c714e0" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:58092 10.134.0.179:443 10.132.0.21:36216 - v1-completions-path 2026-11-03T22:27:03.340337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:27:09.012798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:27:12.412Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 36 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b78d2023-313f-4c12-8007-5cdee5f9ed24" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.179:443 10.132.0.21:55920 - v1-completions-path 2026-11-03T22:27:20.407322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:27:32.605Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 64 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "66b1d61a-a5b3-4214-9fec-4f168cf1285d" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:53882 10.134.0.179:443 10.132.0.21:40384 - v1-completions-path [2026-11-03T22:27:32.864Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "940f7997-19f1-4b82-86a4-e92ecd18d804" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:53882 10.134.0.179:443 10.132.0.21:40394 - v1-completions-path 2026-11-03T22:27:46.702577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:27:57.480093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:28:17.181470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:28:24.440468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:30:51.556271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:32:19.007500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:32:46.563067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:32:51.270569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:04.049765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:21.033510Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:25.705033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:33:31.032Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "06fabb64-04bc-4b92-85c8-2bd8811aa8fe" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.179:443 10.132.0.21:60502 - v1-completions-path 2026-11-03T22:33:46.184278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:56.653407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:34:02.710339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:34:14.843Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "7d8752e4-6790-4f63-95e3-2cb7535c7d11" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:34062 10.134.0.179:443 10.132.0.21:37650 - v1-completions-path 2026-11-03T22:34:29.888871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:34:36.034807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:34:42.064801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:34:49.467Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a9fb502c-4193-41a4-9bde-dd2a2962e016" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.179:34062 10.134.0.179:443 10.132.0.21:58684 - v1-completions-path [2026-11-03T22:34:50.911Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 54 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "5362668e-72e6-40b2-895d-44e9dd8db6a0" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.179:443 10.132.0.21:58698 - v1-completions-path 2026-11-03T22:34:58.560023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:34:58.560059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:34:58.560087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T22:34:58.560093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T22:34:58.442Z] "DELETE /v1/api-keys/26871a2f-2095-406c-b873-596ca1f589e1 HTTP/1.1" 200 - via_upstream - "-" 0 363 117 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a88a4039-9d76-478f-b5d1-6581cb7beca6" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.201:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.179:40550 10.134.0.179:443 10.132.0.21:43780 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:35:12.638962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:35:23.305185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:35:29.597698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:35:35.442475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:35:47.921640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:11.303102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:22.029351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:26.794255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:30.812898Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T22:36:45.081398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:51.193108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:37:12.843159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:37:34.763399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:37:56.815746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:16.624486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:27.482795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:38.421391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:49.073088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:59.915560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:39:10.590047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8