2026-10-31T04:32:08.813705Z info FLAG: --concurrency="0" 2026-10-31T04:32:08.813732Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T04:32:08.813736Z info FLAG: --help="false" 2026-10-31T04:32:08.813738Z info FLAG: --log_as_json="false" 2026-10-31T04:32:08.813741Z info FLAG: --log_caller="" 2026-10-31T04:32:08.813742Z info FLAG: --log_output_level="default:info" 2026-10-31T04:32:08.813745Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T04:32:08.813749Z info FLAG: --log_target="[stdout]" 2026-10-31T04:32:08.813752Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T04:32:08.813754Z info FLAG: --outlierLogPath="" 2026-10-31T04:32:08.813756Z info FLAG: --profiling="true" 2026-10-31T04:32:08.813758Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T04:32:08.813760Z info FLAG: --proxyLogLevel="warning" 2026-10-31T04:32:08.813762Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T04:32:08.813764Z info FLAG: --stsPort="0" 2026-10-31T04:32:08.813766Z info FLAG: --templateFile="" 2026-10-31T04:32:08.813767Z info FLAG: --tokenManagerPlugin="" 2026-10-31T04:32:08.813770Z info FLAG: --vklog="0" 2026-10-31T04:32:08.813773Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T04:32:08.813936Z info Proxy role ips=[10.134.0.149] type=router id=maas-default-gateway-openshift-default-6886b96f9-5smg5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T04:32:08.813976Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T04:32:08.815464Z info cpu limit detected as 2, setting concurrency 2026-10-31T04:32:08.815658Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T04:32:08.815669Z info JWT policy is third-party-jwt 2026-10-31T04:32:08.815672Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T04:32:08.817344Z info Starting default Istio SDS Server 2026-10-31T04:32:08.817334Z info Opening status port 15020 2026-10-31T04:32:08.817367Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T04:32:08.817390Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T04:32:08.818228Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T04:32:08.819910Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T04:32:08.821921Z info sds Starting SDS grpc server 2026-10-31T04:32:08.821939Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T04:32:08.822103Z info Starting proxy agent 2026-10-31T04:32:08.822129Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T04:32:08.886754Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T04:32:08.914010Z info cache generated new workload certificate resourceName=default latency=95.855576ms ttl=23h59m59.085993447s 2026-10-31T04:32:08.914047Z info cache Root cert has changed, start rotating root cert 2026-10-31T04:32:08.914087Z info cache returned workload trust anchor from cache ttl=23h59m59.085913912s 2026-10-31T04:32:09.039243Z info ads ADS: new connection for node:1 2026-10-31T04:32:09.039322Z info cache returned workload certificate from cache ttl=23h59m58.960680711s 2026-10-31T04:32:09.039505Z info ads ADS: new connection for node:2 2026-10-31T04:32:09.039576Z info cache returned workload trust anchor from cache ttl=23h59m58.960425149s 2026-10-31T04:32:09.123712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:32:17.142405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:32:18.300942Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T04:32:19.196463Z info Readiness succeeded in 10.385031916s 2026-10-31T04:32:19.196849Z info Envoy proxy is ready 2026-10-31T04:32:25.457671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:32:34.657245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:32:51.572933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:33:03.339947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:33:07.922423Z info ads ADS: new connection for node:3 2026-10-31T04:33:07.922594Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T04:33:07.922626Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T04:33:14.897725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:33:54.202146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:34:18.260443Z info ads ADS: "" 3 terminated with stream closed 2026-10-31T04:34:18.570764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:34:23.458704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:34:40.467157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:36:52.343773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:36:52.343829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:36:52.343850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:36:52.343857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T04:36:52.195Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 147 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "da1f06d6-ba7b-48a5-943a-0df3198578e1" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.149:36956 10.134.0.149:443 10.132.0.15:51630 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T04:37:11.104754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:37:33.833296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:38:01.235572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:38:12.825097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:38:19.561245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:38:32.600008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:38:37.404009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:38:55.339259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T04:39:12.322Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 87 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "8ce523e4-85c0-496e-b242-d6dbbcae3240" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:48334 10.134.0.149:443 10.132.0.15:55728 - v1-completions-path [2026-10-31T04:39:41.755Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 74 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "6ac64a62-e044-932a-bd09-0fe25be891df" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:48334 10.134.0.149:443 10.132.0.15:59296 - v1-completions-path 2026-10-31T04:39:43.490378Z info ads ADS: new connection for node:4 2026-10-31T04:39:43.493897Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T04:39:43.493945Z info cache read certificate from file resource=file-root:system 2026-10-31T04:39:47.402033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:39:48.430498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:40:41.588923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:40:41.588955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:40:41.588963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:40:41.588968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:40:41.589132Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T04:40:41.371Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 218 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "44bbf435-99a6-417a-9098-79bef8650759" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.149:41072 10.134.0.149:443 10.132.0.15:55906 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T04:40:46.205598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T04:40:46.278129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:40:46.278160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:40:46.278170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:40:46.278175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:40:46.278324Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T04:40:46.140Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 137 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "1b0f93a4-ac77-438e-993e-220b34ad9a70" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.149:41072 10.134.0.149:443 10.132.0.15:48778 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T04:41:09.960007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:41:09.960040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:41:09.960051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T04:41:09.960056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:41:09.960239Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T04:41:09.725Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1711 235 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "57edbe9a-4ee6-485b-b59b-7ebd90c97e5e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.149:33562 10.134.0.149:443 10.132.0.15:54236 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T04:41:30.663501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:41:30.663541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:41:30.663556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:41:30.663561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T04:41:30.550Z] "DELETE /v1/api-keys/8c9e9924-5c77-4923-8709-8b8bd1761106 HTTP/1.1" 200 - via_upstream - "-" 0 359 113 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "a5cd0297-501e-447f-b418-e8403235df55" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.149:57624 10.134.0.149:443 10.132.0.15:54854 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T04:41:43.897635Z info ads ADS: "" 4 terminated 2026-10-31T04:41:43.939543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:41:46.671174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:41:57.076518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:42:16.362521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:42:20.921003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T04:42:23.972Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 76 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "b45c3b69-6543-4bcd-bc3d-b8c2835ec4e2" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:37654 10.134.0.149:443 10.132.0.15:35258 - v1-completions-path 2026-10-31T04:42:45.019701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:42:59.751166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T04:43:08.310Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 68 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "a282a1d7-4aed-44c3-a357-a8885fcd02f3" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:36566 10.134.0.149:443 10.132.0.15:38512 - v1-completions-path [2026-10-31T04:43:08.564Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "99a74ab2-7e86-4485-9e31-494f62c09568" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:36566 10.134.0.149:443 10.132.0.15:38518 - v1-completions-path [2026-10-31T04:43:10.587Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "040864a3-aa3c-417f-b747-e32abb16020d" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:36566 10.134.0.149:443 10.132.0.15:38542 - v1-completions-path [2026-10-31T04:43:11.879Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "830cf0e7-bf10-43f8-b235-feb869b33c49" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:36566 10.134.0.149:443 10.132.0.15:38546 - v1-completions-path [2026-10-31T04:43:14.231Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "3fed4eeb-6c14-4dbb-93e6-e7e163dce3e1" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:36566 10.134.0.149:443 10.132.0.15:50266 - v1-completions-path 2026-10-31T04:43:31.936525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:43:42.587894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:43:48.966966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:43:59.446692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:43:59.446721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-31T04:43:59.446738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:43:59.446756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T04:43:59.446761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T04:43:59.326Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 120 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "a74a2372-4a64-44c9-a216-8c1fc8186da6" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.149:38388 10.134.0.149:443 10.132.0.15:38562 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T04:43:59.636Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 67 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "32df8e6a-35c9-4734-955a-d5855452c26a" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:37654 10.134.0.149:443 10.132.0.15:38580 - v1-completions-path [2026-10-31T04:44:00.945Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "dc50c42d-f073-4533-bd60-0ee60aec290c" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:36566 10.134.0.149:443 10.132.0.15:38588 - v1-completions-path [2026-10-31T04:44:01.442Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "aedb53bf-9fec-4aa3-a1a7-83290e69594b" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:37654 10.134.0.149:443 10.132.0.15:38598 - v1-completions-path 2026-10-31T04:44:16.970699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:44:21.327445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:44:32.691129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:44:41.156868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:44:51.317891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:44:59.773127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:45:08.893778Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:45:27.039140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:45:29.894140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:45:29.894180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:45:29.894196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:45:29.894201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T04:45:29.584Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 309 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "290af4e6-b771-4f2f-91c0-ce20b38b147b" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.149:42158 10.134.0.149:443 10.132.0.15:52680 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T04:45:32.362Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 60 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "03bf5238-3ce4-97db-8917-d4df99a241b5" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.149:443 10.132.0.15:52706 - v1-completions-path 2026-10-31T04:45:32.986525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:45:53.295604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:45:58.383549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:46:10.671722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:46:19.238362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:46:19.238401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:46:19.238418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:46:19.238424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T04:46:19.128Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 109 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "80704f30-0bca-43fc-ae43-5eef74ef9b7c" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.149:34532 10.134.0.149:443 10.132.0.15:45570 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T04:46:33.258314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:46:44.079311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:47:03.014785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:47:10.566741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:49:36.268109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:51:05.284193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:51:22.633729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:51:27.728708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:51:41.221564Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:51:56.725569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:52:00.379119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:52:12.865319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:52:12.865359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:52:12.865376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:52:12.865382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T04:52:01.022Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 11842 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "a5353dd1-3ceb-47ef-9f40-2376a1b2c7b8" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.219:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.149:45826 10.134.0.149:443 10.132.0.15:60506 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T04:52:13.057Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 75 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "8b9981c3-cbd7-411d-88ab-1c5a1a6bc2b2" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:36566 10.134.0.149:443 10.132.0.15:57696 - v1-completions-path 2026-10-31T04:52:29.633469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:52:40.354396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:52:46.541725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T04:53:02.531Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "31185035-611f-45bb-b3a2-012370344e67" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.149:443 10.132.0.15:49424 - v1-completions-path 2026-10-31T04:53:16.904534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:53:23.324346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:53:29.778968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T04:53:36.412Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 71 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "c8ce8ff2-cefc-4d7c-9cdf-2da9cfd410e8" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:36566 10.134.0.149:443 10.132.0.15:45066 - v1-completions-path [2026-10-31T04:53:36.791Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 72 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "0ce4eb11-b6a4-4dfe-b9c3-5b920ffce6dd" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:37654 10.134.0.149:443 10.132.0.15:45076 - v1-completions-path [2026-10-31T04:53:39.589Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "5105736d-a8bf-42e1-8c8a-8e06516ce0aa" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:37654 10.134.0.149:443 10.132.0.15:45098 - v1-completions-path [2026-10-31T04:53:42.890Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "87fcf81f-8db4-4d43-a261-131c1686af10" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.149:37654 10.134.0.149:443 10.132.0.15:45118 - v1-completions-path 2026-10-31T04:53:58.668376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:54:09.338012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:54:16.079133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:54:22.283818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:54:32.063036Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T04:54:43.395Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "a78d584d-08bc-49ad-a5e3-83e1c2fcc130" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.149:443 10.132.0.15:60216 - v1-completions-path 2026-10-31T04:54:57.187408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:55:07.934293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:55:12.882424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:55:30.925526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:55:37.424483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:55:58.494646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:56:18.392751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:56:29.369199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:56:40.231898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:56:51.287081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:57:01.944241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:57:12.887888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:57:23.442011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:57:34.261961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:57:45.045430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:57:55.759728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8