2026-11-03T10:01:03.146740Z info FLAG: --concurrency="0" 2026-11-03T10:01:03.146766Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T10:01:03.146771Z info FLAG: --help="false" 2026-11-03T10:01:03.146773Z info FLAG: --log_as_json="false" 2026-11-03T10:01:03.146775Z info FLAG: --log_caller="" 2026-11-03T10:01:03.146777Z info FLAG: --log_output_level="default:info" 2026-11-03T10:01:03.146779Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T10:01:03.146783Z info FLAG: --log_target="[stdout]" 2026-11-03T10:01:03.146785Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T10:01:03.146787Z info FLAG: --outlierLogPath="" 2026-11-03T10:01:03.146789Z info FLAG: --profiling="true" 2026-11-03T10:01:03.146791Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T10:01:03.146793Z info FLAG: --proxyLogLevel="warning" 2026-11-03T10:01:03.146795Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T10:01:03.146798Z info FLAG: --stsPort="0" 2026-11-03T10:01:03.146799Z info FLAG: --templateFile="" 2026-11-03T10:01:03.146801Z info FLAG: --tokenManagerPlugin="" 2026-11-03T10:01:03.146804Z info FLAG: --vklog="0" 2026-11-03T10:01:03.146806Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T10:01:03.146958Z info Proxy role ips=[10.132.0.247] type=router id=maas-default-gateway-openshift-default-c9ffffc7f-lg5gm.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T10:01:03.147023Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T10:01:03.148124Z info cpu limit detected as 2, setting concurrency 2026-11-03T10:01:03.148322Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T10:01:03.148334Z info JWT policy is third-party-jwt 2026-11-03T10:01:03.148337Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T10:01:03.150359Z info Starting default Istio SDS Server 2026-11-03T10:01:03.150390Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T10:01:03.150415Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T10:01:03.150896Z info Opening status port 15020 2026-11-03T10:01:03.151785Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T10:01:03.152231Z info sds Starting SDS grpc server 2026-11-03T10:01:03.152247Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T10:01:03.153233Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T10:01:03.154050Z info Starting proxy agent 2026-11-03T10:01:03.154081Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T10:01:03.219718Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T10:01:03.239642Z info cache generated new workload certificate resourceName=default latency=87.310824ms ttl=23h59m59.760361574s 2026-11-03T10:01:03.239677Z info cache Root cert has changed, start rotating root cert 2026-11-03T10:01:03.239712Z info cache returned workload trust anchor from cache ttl=23h59m59.760288521s 2026-11-03T10:01:03.384988Z info ads ADS: new connection for node:1 2026-11-03T10:01:03.385061Z info cache returned workload certificate from cache ttl=23h59m59.614941761s 2026-11-03T10:01:03.385291Z info ads ADS: new connection for node:2 2026-11-03T10:01:03.385371Z info cache returned workload trust anchor from cache ttl=23h59m59.614631377s 2026-11-03T10:01:03.484916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:01:11.930714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:01:12.869296Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T10:01:13.637638Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T10:01:14.456621Z info Readiness succeeded in 11.313355281s 2026-11-03T10:01:14.457056Z info Envoy proxy is ready 2026-11-03T10:01:18.905240Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:01:28.520153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:01:45.225698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:01:57.001624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:01:59.804032Z info ads ADS: new connection for node:3 2026-11-03T10:01:59.804248Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T10:01:59.804325Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T10:02:03.804191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:02:52.785887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:03:26.869710Z info ads ADS: "" 3 terminated 2026-11-03T10:03:27.176657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T10:03:31.867Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 88 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2b266c92-75ad-4bc4-aa3f-621813b49ed6" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:57414 10.132.0.247:443 10.132.0.15:42080 - v1-completions-path 2026-11-03T10:03:32.015610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:03:48.942739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:07:09.420292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:07:41.328324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:08:08.089425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:08:08.089469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:08:08.089517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:08:08.089523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T10:08:08.010Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 79 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "30252caa-6cf9-449e-beae-d1d1f4c8fd44" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.247:40764 10.132.0.247:443 10.132.0.15:40550 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T10:08:10.755093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:08:26.361907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:08:41.775712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:08:41.775755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:08:41.775772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:08:41.775777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T10:08:41.653Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 122 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "63b1e1cb-555b-496e-9bdf-0d3c6e76a075" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.247:59688 10.132.0.247:443 10.132.0.15:47438 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T10:08:43.242909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:08:55.731625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:09:00.904283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:09:03.714053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:09:03.714102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:09:03.714123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T10:09:03.714130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T10:09:03.593Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 121 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "7eef41d8-6e14-403a-b9de-07e33a8e4515" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.247:40764 10.132.0.247:443 10.132.0.15:49304 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T10:09:20.431635Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:10:18.445970Z info ads ADS: new connection for node:4 2026-11-03T10:10:18.451735Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T10:10:18.451834Z info cache read certificate from file resource=file-root:system 2026-11-03T10:10:21.943919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:10:24.805408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:11:04.411234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:04.411292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:04.411302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T10:11:04.411306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:04.411463Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T10:11:04.285Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1700 126 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c2b4840a-2a3f-4102-8dae-2b3fc98ec928" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.247:57970 10.132.0.247:443 10.132.0.15:47626 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T10:11:18.255718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T10:11:18.312242Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:18.312274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:18.312285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:18.312289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T10:11:18.312453Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T10:11:18.196Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1708 116 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "8efb0451-8b01-44b8-9f74-599d4a439520" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.247:57970 10.132.0.247:443 10.132.0.15:38424 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T10:11:29.937382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:29.937424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:29.937438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T10:11:29.937444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:29.937719Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T10:11:29.825Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1701 111 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "aeffaaad-984e-4d3f-8b41-a44ecde15d42" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.247:57970 10.132.0.247:443 10.132.0.15:51972 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T10:12:17.639587Z info ads ADS: "" 4 terminated 2026-11-03T10:12:17.683768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:12:20.448114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:12:31.135889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T10:12:34.699Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 74 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "4b12cc79-2211-4e4d-835a-8ec029f1ea3e" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:44952 10.132.0.247:443 10.132.0.15:41680 - v1-completions-path 2026-11-03T10:12:49.582160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:12:54.277732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T10:12:57.527Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "89270e3d-b1ae-4710-ad62-f7c53e57fc89" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:44952 10.132.0.247:443 10.132.0.15:56408 - v1-completions-path [2026-11-03T10:12:59.125Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 59 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "de5d7999-0bf4-4061-b1d3-a1bc853e674c" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:44952 10.132.0.247:443 10.132.0.15:56418 - v1-completions-path [2026-11-03T10:13:00.952Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 53 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "15f17b94-c7f5-4a9d-bbef-5ac123611de5" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.247:443 10.132.0.15:56436 - v1-completions-path 2026-11-03T10:13:15.026539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:13:41.819340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:13:48.556731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:13:48.556774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:13:48.556794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T10:13:48.556801Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T10:13:48.447Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 109 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "5392285c-f188-45a4-ab9f-46b7da92e9f5" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.247:33048 10.132.0.247:443 10.132.0.15:53508 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T10:13:53.163Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "9ab88644-ea8a-4a70-9b48-94b45ef4a845" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:44952 10.132.0.247:443 10.132.0.15:39652 - v1-completions-path [2026-11-03T10:13:53.681Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "97385ee6-7c6b-4476-b917-d1b0f4f57a4c" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:44952 10.132.0.247:443 10.132.0.15:39662 - v1-completions-path 2026-11-03T10:14:22.615761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:14:33.341320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:14:40.209919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T10:14:54.136Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 66 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "6b2889d2-323b-4c20-978b-9de3931f56c0" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:40734 10.132.0.247:443 10.132.0.15:58246 - v1-completions-path [2026-11-03T10:14:54.691Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "70204801-9007-4dcd-aabf-38c63d332ce1" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:44952 10.132.0.247:443 10.132.0.15:58262 - v1-completions-path [2026-11-03T10:14:55.994Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "f92c1fc9-7fb2-4789-bd57-cc126aa06ea8" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:40734 10.132.0.247:443 10.132.0.15:58284 - v1-completions-path 2026-11-03T10:15:11.251383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:15:16.005032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T10:15:19.422Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 291 77 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "05ae7a64-65dd-45bf-b5c5-50c7d9e680c0" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:39984 10.132.0.247:443 10.132.0.15:37284 - v1-completions-path 2026-11-03T10:15:28.145253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:15:38.519185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T10:16:00.561Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 73 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "35a87f42-e3d3-4f6a-a15f-33f9a736e14c" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:57414 10.132.0.247:443 10.132.0.15:60490 - v1-completions-path 2026-11-03T10:16:05.107601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:16:15.985240Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:16:33.946721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:17:03.671431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:17:25.371245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:17:36.049326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:21:42.955045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:22:00.417395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:22:05.138263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:22:18.669331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:22:38.330382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:22:43.302344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:23:03.295270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:23:13.936744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:23:20.350440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:23:49.351441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:23:55.854921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:24:01.850051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:24:17.988641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-03T10:24:17.925Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 67 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "7405f12a-1809-461b-bf57-c09c3f4b5c53" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:40734 10.132.0.247:443 10.132.0.15:45108 - v1-completions-path 2026-11-03T10:24:34.244593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:24:44.839911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:24:51.474714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:24:57.515652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:25:09.402609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T10:25:18.512Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "29bc6bdd-a5a9-4d0f-974c-3020ed0fc502" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.247:40734 10.132.0.247:443 10.132.0.15:57096 - v1-completions-path 2026-11-03T10:25:33.132172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:25:43.587718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:25:48.493253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:26:06.820252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:26:13.010216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:26:36.601933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:26:59.066309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:27:20.679411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:27:40.716669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:27:51.508825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:28:02.181030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:28:13.000881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:28:23.807035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T10:28:34.408846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8