2026-10-30T07:19:32.011223Z info FLAG: --concurrency="0" 2026-10-30T07:19:32.011242Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T07:19:32.011248Z info FLAG: --help="false" 2026-10-30T07:19:32.011252Z info FLAG: --log_as_json="false" 2026-10-30T07:19:32.011255Z info FLAG: --log_caller="" 2026-10-30T07:19:32.011259Z info FLAG: --log_output_level="default:info" 2026-10-30T07:19:32.011262Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T07:19:32.011268Z info FLAG: --log_target="[stdout]" 2026-10-30T07:19:32.011273Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T07:19:32.011276Z info FLAG: --outlierLogPath="" 2026-10-30T07:19:32.011279Z info FLAG: --profiling="true" 2026-10-30T07:19:32.011282Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T07:19:32.011285Z info FLAG: --proxyLogLevel="warning" 2026-10-30T07:19:32.011288Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T07:19:32.011291Z info FLAG: --stsPort="0" 2026-10-30T07:19:32.011294Z info FLAG: --templateFile="" 2026-10-30T07:19:32.011297Z info FLAG: --tokenManagerPlugin="" 2026-10-30T07:19:32.011302Z info FLAG: --vklog="0" 2026-10-30T07:19:32.011306Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T07:19:32.011525Z info Proxy role ips=[10.134.0.226] type=router id=maas-default-gateway-openshift-default-59f957fdd7-8g5f6.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T07:19:32.011605Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T07:19:32.013084Z info cpu limit detected as 2, setting concurrency 2026-10-30T07:19:32.013385Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T07:19:32.013400Z info JWT policy is third-party-jwt 2026-10-30T07:19:32.013404Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T07:19:32.016855Z info Starting default Istio SDS Server 2026-10-30T07:19:32.016884Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T07:19:32.016915Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T07:19:32.017095Z info Opening status port 15020 2026-10-30T07:19:32.017789Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T07:19:32.017987Z info sds Starting SDS grpc server 2026-10-30T07:19:32.018058Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T07:19:32.019448Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T07:19:32.020283Z info Starting proxy agent 2026-10-30T07:19:32.020318Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T07:19:32.111397Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T07:19:32.174731Z info cache generated new workload certificate resourceName=default latency=156.587876ms ttl=23h59m59.825273336s 2026-10-30T07:19:32.174771Z info cache Root cert has changed, start rotating root cert 2026-10-30T07:19:32.174807Z info cache returned workload trust anchor from cache ttl=23h59m59.825193671s 2026-10-30T07:19:32.363432Z info ads ADS: new connection for node:1 2026-10-30T07:19:32.370336Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T07:19:32.370389Z info cache read certificate from file resource=file-root:system 2026-10-30T07:19:32.399396Z info ads ADS: new connection for node:2 2026-10-30T07:19:32.399451Z info cache returned workload certificate from cache ttl=23h59m59.600550224s 2026-10-30T07:19:32.400355Z info ads ADS: new connection for node:3 2026-10-30T07:19:32.400418Z info cache returned workload trust anchor from cache ttl=23h59m59.599583612s 2026-10-30T07:19:32.504265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:19:41.054768Z info Readiness succeeded in 9.046207012s 2026-10-30T07:19:41.055197Z info Envoy proxy is ready 2026-10-30T07:19:58.028671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:20:14.586032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:20:17.077375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:20:23.150533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:20:32.491049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:20:38.643530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:20:48.144643Z info ads ADS: new connection for node:4 2026-10-30T07:20:48.144843Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:20:48.144919Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:20:59.684552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:21:10.443107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:21:24.275750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:21:58.490610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:22:15.763040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:22:42.769479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:24:30.183667Z info ads ADS: "" 4 terminated 2026-10-30T07:24:52.595978Z info ads ADS: "" 1 terminated with stream closed 2026-10-30T07:31:22.284047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:32:42.934833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:36:19.229528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:38:17.384432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:46:53.833354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:47:16.843446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:47:28.489306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:47:28.489342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:47:28.489355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:47:28.489360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T07:47:28.383Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 106 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "80715145-6d02-972b-b91c-c1acc224745a" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.226:39170 10.134.0.226:443 10.132.0.10:53228 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:47:34.165127Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T07:47:52.610188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:48:08.878060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:48:11.343456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:48:19.020964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:48:24.827490Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T07:48:24.741Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 85 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "66ddfabc-7da6-41f0-a597-fddbb823b49d" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:53252 10.134.0.226:443 10.132.0.10:36204 - v1-catch-all-path 2026-10-30T07:48:37.070943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:48:39.286165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:48:53.938777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:49:05.129176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:49:07.041989Z info ads ADS: new connection for node:5 2026-10-30T07:49:07.042229Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:49:08.782390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:49:49.506605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T07:49:54.644Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 343 86 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "c9ef48f6-0bbb-4d55-8282-f369079f3fff" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.1.13:8000" outbound|54321||e2e-prio-pool-0fdfdccb-inference-pool-ip-2d07c08b.llm.svc.cluster.local 10.134.0.226:46190 10.134.0.226:443 10.132.0.10:34208 - v1-model-routing 2026-10-30T07:50:08.388483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:50:08.479758Z info ads ADS: "" 5 terminated 2026-10-30T07:50:10.704485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:50:13.440014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:50:18.360856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:51:53.734384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:52:10.697152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:52:26.301285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:52:38.222307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:52:44.551632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:52:44.571348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:52:44.571383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:52:44.571395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:52:44.571400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T07:52:44.485Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 86 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "c9e35946-879a-45d1-95d4-1498891367ab" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.226:40908 10.134.0.226:443 10.132.0.10:37728 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:52:56.377218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:53:00.957259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:53:19.069956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:54:05.399096Z info ads ADS: new connection for node:6 2026-10-30T07:54:05.404220Z info cache read certificate from file resource=file-root:system 2026-10-30T07:54:06.637266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:54:07.793241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:54:25.325031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T07:54:25.375701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:25.375729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:25.375741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:54:25.375752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:25.375900Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:54:25.261Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1732 114 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "331de932-e0c7-4ebf-a632-16256e7681ad" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.226:54590 10.134.0.226:443 10.132.0.10:38424 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:54:40.292047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:40.292082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:40.292094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:40.292098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:54:40.292253Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:54:40.191Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1734 100 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "4ee4abba-cf2c-4626-860e-1da72964c860" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.226:54590 10.134.0.226:443 10.132.0.10:58532 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:51.152998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:55:51.286270Z info ads ADS: "" 6 terminated 2026-10-30T07:55:51.609071Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T07:55:51.609093Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T07:55:51.609096Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T07:55:51.609100Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 2026-10-30T07:55:51.771035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T07:55:51.574Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 34 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d59b674c-0c34-4dcb-8555-71bbe6af7d61" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.226:443 10.132.0.10:46696 - v1-completions-path 2026-10-30T07:55:54.711763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:55:59.574085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:56:19.363410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:56:23.502399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:56:39.182784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:56:55.047445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T07:57:02.004Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 78 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "382b2908-34af-40e0-bf1f-78b6ce5fff0b" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:44190 10.134.0.226:443 10.132.0.10:59282 - v1-completions-path 2026-10-30T07:57:17.382172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:57:27.678746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:57:31.869668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T07:57:36.230Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f672a0ec-6c43-4d49-94de-7a7ecf333f94" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:44190 10.134.0.226:443 10.132.0.10:36564 - v1-completions-path [2026-10-30T07:57:37.102Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f71bc336-507b-44b4-8129-a52275e1569c" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:44932 10.134.0.226:443 10.132.0.10:36576 - v1-completions-path 2026-10-30T07:57:49.095336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:57:51.387569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:58:10.651697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:58:15.586841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:58:30.931164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:58:33.110981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:58:50.887709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:59:01.701395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:59:04.524803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:59:32.668302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T07:59:50.674724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:00:01.010171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:00:05.191827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:00:05.191868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:00:05.191887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:00:05.191894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T08:00:05.116Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 75 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "64cb91e8-b8bc-4c17-9c33-15bc39aa17c7" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.226:46778 10.134.0.226:443 10.132.0.10:37994 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T08:03:28.680408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:03:43.890644Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:03:46.100712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:04:05.235970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:04:17.334443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:04:20.905074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T08:04:24.214Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "ece1848d-dc40-4222-be63-6575aa75eff5" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:44190 10.134.0.226:443 10.132.0.10:57976 - v1-completions-path [2026-10-30T08:04:24.822Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b96cad5c-985f-4a7e-ae94-82500d846666" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.226:443 10.132.0.10:57984 - v1-completions-path 2026-10-30T08:04:37.017898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:04:47.479441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:04:52.303492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:04:56.109248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T08:04:56.109288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T08:04:56.109306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T08:04:56.109313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T08:04:56.029Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 79 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "9c2c1fa9-b1b1-4531-b11b-c274ae418a3c" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.1.23:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.226:59862 10.134.0.226:443 10.132.0.10:51086 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T08:05:09.323663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:05:14.224446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:05:17.126776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:05:23.431356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T08:05:23.370Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "9ce37e35-ae66-4723-a538-7f69cc91a0ec" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:44932 10.134.0.226:443 10.132.0.10:45746 - v1-completions-path [2026-10-30T08:05:24.407Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "18c0a545-6e03-40f0-be6d-3880d2ce46c6" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:44932 10.134.0.226:443 10.132.0.10:45760 - v1-completions-path [2026-10-30T08:05:25.704Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "3bbf6913-eee1-99d5-ba8e-c9b40b2f0873" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:44190 10.134.0.226:443 10.132.0.10:45784 - v1-completions-path 2026-10-30T08:05:40.135714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:05:50.463203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:05:54.846721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:05:57.614675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:06:01.269278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T08:06:05.722Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "0a1ebf0e-f85b-4e9d-b4a7-2bdb4408af40" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:44932 10.134.0.226:443 10.132.0.10:43232 - v1-completions-path 2026-10-30T08:06:06.643082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:06:06.643121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:06:06.643136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T08:06:06.643141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T08:06:06.566Z] "DELETE /v1/api-keys/c39ec317-1107-4ec0-a0e5-9ba8a68a19b3 HTTP/1.1" 200 - via_upstream - "-" 0 367 76 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "6f2357da-7e07-4e64-88c7-16223fe45f23" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.1.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.226:41780 10.134.0.226:443 10.132.0.10:43236 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T08:06:18.607075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:06:28.951164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:06:31.310400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:06:40.981558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:06:46.190884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:07:02.831138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:07:22.999815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:07:33.405042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:07:43.859572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:07:54.399727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:07:57.621157Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-30T08:08:04.649492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:08:15.036368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:08:25.405426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:08:35.788112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:08:46.153329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T08:08:56.497564Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T08:08:59.088Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 86 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "ada182ee-7895-4213-bfb0-a8f5171c7370" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.226:52918 10.134.0.226:443 10.132.0.10:52938 - v1-completions-path