2026-11-02T07:17:55.783930Z info FLAG: --concurrency="0" 2026-11-02T07:17:55.783958Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T07:17:55.783963Z info FLAG: --help="false" 2026-11-02T07:17:55.783965Z info FLAG: --log_as_json="false" 2026-11-02T07:17:55.783967Z info FLAG: --log_caller="" 2026-11-02T07:17:55.783969Z info FLAG: --log_output_level="default:info" 2026-11-02T07:17:55.783971Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T07:17:55.783976Z info FLAG: --log_target="[stdout]" 2026-11-02T07:17:55.783978Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T07:17:55.783980Z info FLAG: --outlierLogPath="" 2026-11-02T07:17:55.783983Z info FLAG: --profiling="true" 2026-11-02T07:17:55.783985Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T07:17:55.783987Z info FLAG: --proxyLogLevel="warning" 2026-11-02T07:17:55.783990Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T07:17:55.783992Z info FLAG: --stsPort="0" 2026-11-02T07:17:55.783994Z info FLAG: --templateFile="" 2026-11-02T07:17:55.783995Z info FLAG: --tokenManagerPlugin="" 2026-11-02T07:17:55.783998Z info FLAG: --vklog="0" 2026-11-02T07:17:55.784001Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T07:17:55.784133Z info Proxy role ips=[10.134.0.65] type=router id=maas-default-gateway-openshift-default-7d64fcddb7-rc2gq.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T07:17:55.784175Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T07:17:55.785283Z info cpu limit detected as 2, setting concurrency 2026-11-02T07:17:55.785502Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T07:17:55.785515Z info JWT policy is third-party-jwt 2026-11-02T07:17:55.785518Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T07:17:55.787778Z info Starting default Istio SDS Server 2026-11-02T07:17:55.787806Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T07:17:55.787838Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T07:17:55.788340Z info Opening status port 15020 2026-11-02T07:17:55.788895Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T07:17:55.790073Z info sds Starting SDS grpc server 2026-11-02T07:17:55.790088Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T07:17:55.790604Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T07:17:55.791431Z info Starting proxy agent 2026-11-02T07:17:55.791483Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T07:17:55.859480Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T07:17:56.048160Z info ads ADS: new connection for node:1 2026-11-02T07:17:56.057949Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T07:17:56.058006Z info cache read certificate from file resource=file-root:system 2026-11-02T07:17:56.082868Z info ads ADS: new connection for node:2 2026-11-02T07:17:56.083535Z info ads ADS: new connection for node:3 2026-11-02T07:17:56.185450Z info cache generated new workload certificate resourceName=default latency=395.200969ms ttl=23h59m59.814554377s 2026-11-02T07:17:56.185488Z info cache Root cert has changed, start rotating root cert 2026-11-02T07:17:56.185546Z info cache returned workload trust anchor from cache ttl=23h59m59.814456164s 2026-11-02T07:17:56.185560Z info cache returned workload certificate from cache ttl=23h59m59.814445631s 2026-11-02T07:17:56.185697Z info cache returned workload trust anchor from cache ttl=23h59m59.81430378s 2026-11-02T07:17:56.185792Z info cache returned workload trust anchor from cache ttl=23h59m59.814209726s 2026-11-02T07:17:56.309170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:18:04.369496Z info Readiness succeeded in 8.58829896s 2026-11-02T07:18:04.369908Z info Envoy proxy is ready 2026-11-02T07:18:13.481186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:18:43.336572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:19:00.837541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T07:19:11.491Z] "POST /llm/e2e-rt-eq-f2a240/anything/e2e-rt-eq-f2a240-client HTTP/1.1" 503 - - "-" 124 0 79 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "2f50c5c4-ba04-45af-8395-babaabd38be3" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-f2a240.llm.svc.cluster.local - 10.134.0.65:443 10.132.0.19:45164 - llm.external-model-e2e-rt-eq-f2a240-ca9ee08cf35d.4 [2026-11-02T07:20:04.720Z] "POST /llm/e2e-rt-eq-f2a240/anything/e2e-rt-eq-f2a240-client HTTP/1.1" 503 - - "-" 124 0 71 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "28ecf3ad-73e3-4d7b-854d-630312c66857" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-f2a240.llm.svc.cluster.local - 10.134.0.65:443 10.132.0.19:45018 - llm.external-model-e2e-rt-eq-f2a240-ca9ee08cf35d.4 [2026-11-02T07:20:25.959Z] "POST /llm/e2e-rt-eq-f2a240/anything/e2e-rt-eq-f2a240-client HTTP/1.1" 503 - - "-" 124 0 68 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8dbfaaef-5a3b-4e35-bb41-6b75d07f212b" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-f2a240.llm.svc.cluster.local - 10.134.0.65:443 10.132.0.19:48004 - llm.external-model-e2e-rt-eq-f2a240-ca9ee08cf35d.4 2026-11-02T07:22:44.683627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:22:48.233934Z info ads ADS: "" 1 terminated 2026-11-02T07:22:48.338980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:23:01.576224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:23:24.144779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:25:03.470342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:26:18.377890Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:27:55.238440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:27:55.238484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:27:55.238505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T07:27:55.238512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T07:27:55.015Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 222 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "fc6f0973-f186-4469-a94e-696eda34d0d6" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:48572 10.134.0.65:443 10.132.0.19:55506 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T07:28:03.246735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:28:03.246770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:28:03.246783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:28:03.246789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T07:28:03.132Z] "DELETE /v1/api-keys/5b9372fc-f152-4aef-96b5-d9994a310651 HTTP/1.1" 200 - via_upstream - "-" 0 321 114 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "51d21e0f-b59d-451c-86e4-84f3fd440652" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:48572 10.134.0.65:443 10.132.0.19:54896 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T07:28:15.343961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:28:15.343997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:28:15.344011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:28:15.344016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T07:28:15.235Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 108 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e642c2f9-e9c7-43dd-9417-2fbda0fdf419" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:48572 10.134.0.65:443 10.132.0.19:39646 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T07:28:38.555830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:29:12.688856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T07:40:52.253676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:40:52.253720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:40:52.253744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T07:40:52.253751Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T07:40:51.995Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 258 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "026823cb-0cb4-4cf2-a93c-12566a3d44d7" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:37384 10.134.0.65:443 10.132.0.19:53514 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T07:42:45.345657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T07:42:45.345698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T07:42:45.345714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T07:42:45.345719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T07:42:45.212Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 133 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "cd5d19e4-ded6-43f3-88c1-518dbf5d5059" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:51176 10.134.0.65:443 10.132.0.19:53638 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T07:42:45.625153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T07:42:46.161724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T07:42:46.161759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T07:42:46.161771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T07:42:46.161776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T07:42:46.161950Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-02T07:42:46.162004Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T07:42:46.162012Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T07:42:46.162014Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T07:42:46.162018Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T07:42:45.547Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 334 94 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "600ae661-4a83-49e0-8c2d-1ee232a796b2" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:36752 10.134.0.65:443 10.132.0.19:53646 - v1-chat-completions-path [2026-11-02T07:42:46.097Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 126 129 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "9130e7d9-bcbb-466b-8965-952bdf33334d" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:36766 10.134.0.65:443 10.132.0.19:53650 - v1-chat-completions-path 2026-11-02T07:46:28.515345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:46:28.515395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T07:46:28.515422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T07:46:28.515432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T07:46:28.404Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 110 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8a35f73d-d60d-4a7b-ad2a-04104d1d2594" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:38438 10.134.0.65:443 10.132.0.19:41180 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T07:47:00.255314Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 [2026-11-02T07:55:37.128Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 8 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d3ade39d-76c8-48a9-adf7-935d124f44f5" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.65:443 10.132.0.19:42634 - - 2026-11-02T08:05:11.420039Z info ads ADS: new connection for node:4 2026-11-02T08:05:11.425379Z info cache read certificate from file resource=file-root:system 2026-11-02T08:05:16.213708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:05:28.309755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:06:01.016579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:06:10.764603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T08:06:10.783598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:06:10.783635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:06:10.783651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:06:10.783657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T08:06:11.214152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:06:11.214187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:06:11.214199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:06:11.214203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T08:06:11.214431Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T08:06:10.600Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 183 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "850eacd4-f4c7-4339-bb3c-66237b44f24b" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:44216 10.134.0.65:443 10.132.0.19:41330 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T08:06:10.977Z] "POST /anything/e2e-dft-4b5941-2b55c0 HTTP/1.1" 200 - via_upstream - "-" 109 1779 236 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "55a92ac9-9f37-4675-ae9f-d1f367028275" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.65:54482 10.134.0.65:443 10.132.0.19:41336 - llm.external-model-e2e-dft-4b5941-320f1c1f1558.0 2026-11-02T08:06:11.924795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:06:11.924827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:06:11.924836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:06:11.924840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T08:06:11.924989Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T08:06:11.792Z] "POST /anything/e2e-dft-4b5941-2b55c0 HTTP/1.1" 200 - via_upstream - "-" 109 1774 132 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0ec7febc-7dbb-4294-a6b2-2944d6fbf539" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.65:54482 10.134.0.65:443 10.132.0.19:41342 - llm.external-model-e2e-dft-4b5941-320f1c1f1558.0 [2026-11-02T08:06:12.147Z] "POST /llm/e2e-dft-4b5941/anything/e2e-dft-4b5941-2b55c0 HTTP/1.1" 401 - - "-" 109 88 141 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0f644814-a7e1-4d4c-bb48-cb6c58d15b92" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-4b5941.llm.svc.cluster.local - 10.134.0.65:443 10.132.0.19:41344 - llm.external-model-e2e-dft-4b5941-320f1c1f1558.2 2026-11-02T08:06:12.696119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:06:12.696152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:06:12.696162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T08:06:12.696167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:06:12.696392Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T08:06:12.475Z] "POST /anything/e2e-dft-4b5941-2b55c0 HTTP/1.1" 200 - via_upstream - "-" 109 1767 220 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "82fe6fb0-62e0-47af-8e24-b96835432877" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.65:54484 10.134.0.65:443 10.132.0.19:59854 - llm.external-model-e2e-dft-4b5941-320f1c1f1558.0 2026-11-02T08:06:24.934490Z info ads ADS: "" 4 terminated 2026-11-02T08:06:25.849652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:06:27.888163Z info ads ADS: new connection for node:5 2026-11-02T08:06:27.900582Z info cache read certificate from file resource=file-root:system 2026-11-02T08:06:32.431016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:06:43.604915Z info ads ADS: "" 5 terminated with stream closed 2026-11-02T08:06:44.630203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:06:50.413915Z info ads ADS: new connection for node:6 2026-11-02T08:06:50.421738Z info cache read certificate from file resource=file-root:system 2026-11-02T08:06:53.179295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:06:56.447253Z info ads ADS: "" 6 terminated 2026-11-02T08:06:57.504300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:06:59.326059Z info ads ADS: new connection for node:7 2026-11-02T08:06:59.331478Z info cache read certificate from file resource=file-root:system 2026-11-02T08:07:04.272227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:07:05.521018Z info ads ADS: "" 7 terminated 2026-11-02T08:07:06.769721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:07:11.328682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:07:56.666653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:12:36.326260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:13:01.129437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:13:19.347069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:13:48.462612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:15:17.978873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:16:57.920378Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T08:30:44.813043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:30:44.813112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:30:44.813136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T08:30:44.813146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T08:30:44.636Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 177 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "58d8344b-0946-46d4-a0f9-baae0c693fe3" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:38186 10.134.0.65:443 10.132.0.19:38008 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T08:31:00.468735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:31:00.510165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:31:00.510213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:31:00.510238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:31:00.510246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T08:31:00.388Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 121 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "312b06bb-0f89-4aff-907c-a4026af2ce1c" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:38186 10.134.0.65:443 10.132.0.19:46274 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T08:31:25.934301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:31:35.945653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:31:35.945686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:31:35.945698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:31:35.945705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T08:31:35.782Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 163 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "9c50c1d3-6a9a-4b94-84fe-452b9378d50a" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:38814 10.134.0.65:443 10.132.0.19:36634 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T08:32:02.439375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:32:02.952716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:32:02.952759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:32:02.952781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T08:32:02.952788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T08:32:02.824Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 304 128 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b978093c-4759-45bc-a7e6-e2e8808af359" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:57298 10.134.0.65:443 10.132.0.19:35388 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T08:32:04.636Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 2817 3089 88 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "76b81bec-5875-4087-b055-384691122b91" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.132.0.44:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:34652 10.134.0.65:443 10.132.0.19:35390 - v1-chat-completions-path 2026-11-02T08:32:19.346147Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T08:32:19.346174Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T08:32:19.346178Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T08:32:19.346183Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T08:32:19.199Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 146 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "649f10b9-cd8a-461f-b206-320616875f6c" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.65:443 10.132.0.19:40764 - v1-catch-all-path 2026-11-02T08:32:20.612998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:32:25.244335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:32:28.099635Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-02T08:32:28.013Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 85 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e3bd7591-675e-4c78-afea-7b76a041d5d4" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:46420 10.134.0.65:443 10.132.0.19:56658 - v1-catch-all-path 2026-11-02T08:32:28.526189Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T08:32:28.464Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 61 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "7b97bac2-b90d-49c6-9fb8-8096b59d902e" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:46424 10.134.0.65:443 10.132.0.19:56664 - v1-catch-all-path 2026-11-02T08:32:35.485940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:32:39.115850Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-02T08:32:39.025Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 90 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "65556811-4bf2-41bf-ad98-c503dba8ddd1" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:46420 10.134.0.65:443 10.132.0.19:33906 - v1-catch-all-path 2026-11-02T08:32:48.836847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:32:58.815576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:33:15.486959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:33:27.067082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:33:30.330736Z info ads ADS: new connection for node:8 2026-11-02T08:33:30.330906Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T08:33:30.330979Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T08:33:33.755806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:34:23.368748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:34:47.314098Z info ads ADS: "" 8 terminated with stream closed 2026-11-02T08:34:47.620464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:34:52.072779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:34:52.072814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:34:52.072829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T08:34:52.072833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:34:52.302255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:34:51.955Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 332 117 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "6356c28c-3fd6-43bf-a251-e860805c83fd" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:48318 10.134.0.65:443 10.132.0.19:35634 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T08:35:06.592741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:38:11.758274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:38:43.288253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:11.654800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:39:11.654840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:39:11.654860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T08:39:11.654865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T08:39:11.586Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 68 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b8ee1d84-395b-4dab-b9ee-fa1bbc714009" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:55178 10.134.0.65:443 10.132.0.19:44866 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T08:39:13.748668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:28.180642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:36.468352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:41.177186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:52.223917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:56.598724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:59.723357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:39:59.723404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:39:59.723431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T08:39:59.723438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T08:39:59.670Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 52 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "1c9b277f-9674-456b-9c35-afbaba96ce22" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:50372 10.134.0.65:443 10.132.0.19:34066 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T08:40:01.312Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 70 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "356067b8-d7b8-4aad-b41e-0c209b08f1f1" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:49762 10.134.0.65:443 10.132.0.19:34070 - v1-completions-path 2026-11-02T08:40:16.831545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:40:43.972Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 67 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "9e423f3e-9c97-4ed0-a00b-aa9be004dcd6" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:36766 10.134.0.65:443 10.132.0.19:48506 - v1-completions-path 2026-11-02T08:41:14.366532Z info ads ADS: new connection for node:9 2026-11-02T08:41:14.373044Z info cache read certificate from file resource=file-root:system 2026-11-02T08:41:18.179097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:41:19.225514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:41:26.997763Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"1179","StreamId":"13532950485759818116"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-02T08:41:26.928Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 69 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e2dc701f-9761-40f9-bf28-5161e7372c85" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.65:443 10.132.0.19:52356 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-02T08:41:58.297239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:41:58.297280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:41:58.297295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T08:41:58.297301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:41:58.297535Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T08:41:58.102Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 194 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "a166876d-6ebd-4ee4-8628-f01c9100a68e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.65:38238 10.134.0.65:443 10.132.0.19:60334 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T08:42:40.470696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:42:40.470729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:42:40.470740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:42:40.470744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T08:42:40.470900Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T08:42:40.344Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 126 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0ae5a493-fac0-4827-a2f8-faa53d1e0980" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.65:38238 10.134.0.65:443 10.132.0.19:35486 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T08:43:02.837379Z info ads ADS: "" 9 terminated 2026-11-02T08:43:02.881491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:43:05.289319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:43:16.255259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:43:34.624327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:43:39.311978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:43:59.472902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:44:18.031133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:44:28.851Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 68 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "59fad547-9862-485b-b765-3c6fb50fe115" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:49762 10.134.0.65:443 10.132.0.19:33154 - v1-completions-path [2026-11-02T08:44:33.525Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "97093f55-4ef1-47ed-a4bd-de03e6e9d38d" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:39168 10.134.0.65:443 10.132.0.19:53214 - v1-completions-path 2026-11-02T08:44:50.422158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:01.153435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:07.292731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:45:19.758Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4c78a671-6e7c-40d3-8551-24fd3da77fb3" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:39168 10.134.0.65:443 10.132.0.19:42540 - v1-completions-path [2026-11-02T08:45:20.260Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "c7a81701-6cf1-4880-b660-c2a3a49c0adb" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:49762 10.134.0.65:443 10.132.0.19:42544 - v1-completions-path 2026-11-02T08:45:35.763593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:41.955600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:56.123826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:46:05.825547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:46:14.933932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:46:23.482588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:46:30.998195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:46:50.509655Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:46:53.325688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:46:53.325727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:46:53.325742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:46:53.325748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T08:46:53.208Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 117 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "71b530d3-4a35-460f-a1c8-a4fa1ea03e37" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.65:53404 10.134.0.65:443 10.132.0.19:51948 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T08:46:53.513Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4d2db8be-16dd-4edd-9699-8f4d9d90c602" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.65:443 10.132.0.19:51954 - v1-completions-path 2026-11-02T08:46:57.031724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:47:15.321977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:47:17.514Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "20228288-1412-4ff2-b96e-8dfd1e7dee02" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.65:443 10.132.0.19:49852 - v1-completions-path 2026-11-02T08:47:20.850394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:47:32.174053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:47:55.821917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:48:06.713738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:48:12.941061Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-11-02T08:48:26.048279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:48:33.389242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:50:50.925501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:20.688134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:40.301275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:45.254396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:58.621021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:53:14.620927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:53:19.604838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:53:39.718791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:53:50.408298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:53:56.887958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:54:11.823Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "80358e96-1048-4c5a-8354-2fff2849fff2" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:49762 10.134.0.65:443 10.132.0.19:33974 - v1-completions-path 2026-11-02T08:54:27.108975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:54:33.538114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:54:39.493629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:54:48.890Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 68 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4eca99eb-9e66-435e-91c8-71c7c871dd17" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:49762 10.134.0.65:443 10.132.0.19:56752 - v1-completions-path [2026-11-02T08:54:52.349Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e2ddd680-f8ba-48e9-ba9b-e11c4bbe0bfa" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:49762 10.134.0.65:443 10.132.0.19:48430 - v1-completions-path [2026-11-02T08:54:53.411Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "db61aa88-42b5-4e5a-97d8-825380501ea8" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:39168 10.134.0.65:443 10.132.0.19:48450 - v1-completions-path [2026-11-02T08:54:53.776Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "6d710d09-7177-48a2-b2d1-4a93df37926a" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:49762 10.134.0.65:443 10.132.0.19:48466 - v1-completions-path [2026-11-02T08:54:54.853Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "46d8cdcc-0fe0-4132-b7ad-23bf1243cfd2" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:39168 10.134.0.65:443 10.132.0.19:48472 - v1-completions-path [2026-11-02T08:54:56.285Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "86553325-690c-48ec-a262-fda31c417000" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:49762 10.134.0.65:443 10.132.0.19:48484 - v1-completions-path 2026-11-02T08:55:12.162683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:55:22.844760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:55:29.596105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:55:35.671948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:55:44.131Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 73 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "bfd52b47-4d74-4276-a791-65c81fa634f1" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:39168 10.134.0.65:443 10.132.0.19:51410 - v1-completions-path 2026-11-02T08:55:47.704380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:55:55.006Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 80 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "89842ec2-e451-4760-8ce0-54afdc1909f1" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:39168 10.134.0.65:443 10.132.0.19:39606 - v1-completions-path [2026-11-02T08:55:56.922Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 70 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "7719b3f5-d120-45c4-b208-b2ee99db3254" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.65:39168 10.134.0.65:443 10.132.0.19:39614 - v1-completions-path 2026-11-02T08:56:03.874860Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-02T08:56:11.271725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:56:21.999275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:56:27.044035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:56:45.377012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:56:53.400300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:16.049836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:36.523717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:47.601586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:58.708348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:09.567589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:20.305558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:31.091610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:41.848465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:52.638827Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:59:03.676933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:59:14.169952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:59:31.123Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 52 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8c610279-19c9-4b89-a147-749d02c69f1d" "maas.apps.c6d8fd6add62b0f2acc5.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.65:443 10.132.0.19:49210 - v1-completions-path