2026-11-03T10:01:03.431815Z info FLAG: --concurrency="0" 2026-11-03T10:01:03.431841Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T10:01:03.431846Z info FLAG: --help="false" 2026-11-03T10:01:03.431849Z info FLAG: --log_as_json="false" 2026-11-03T10:01:03.431852Z info FLAG: --log_caller="" 2026-11-03T10:01:03.431855Z info FLAG: --log_output_level="default:info" 2026-11-03T10:01:03.431858Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T10:01:03.431864Z info FLAG: --log_target="[stdout]" 2026-11-03T10:01:03.431868Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T10:01:03.431871Z info FLAG: --outlierLogPath="" 2026-11-03T10:01:03.431874Z info FLAG: --profiling="true" 2026-11-03T10:01:03.431877Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T10:01:03.431880Z info FLAG: --proxyLogLevel="warning" 2026-11-03T10:01:03.431883Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T10:01:03.431886Z info FLAG: --stsPort="0" 2026-11-03T10:01:03.431889Z info FLAG: --templateFile="" 2026-11-03T10:01:03.431891Z info FLAG: --tokenManagerPlugin="" 2026-11-03T10:01:03.431895Z info FLAG: --vklog="0" 2026-11-03T10:01:03.431898Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T10:01:03.432087Z info Proxy role ips=[10.132.0.248] type=router id=maas-default-gateway-openshift-default-c9ffffc7f-dhjmc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T10:01:03.432159Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T10:01:03.433620Z info cpu limit detected as 2, setting concurrency 2026-11-03T10:01:03.433888Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T10:01:03.433901Z info JWT policy is third-party-jwt 2026-11-03T10:01:03.433906Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T10:01:03.436824Z info Starting default Istio SDS Server 2026-11-03T10:01:03.436858Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T10:01:03.436887Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T10:01:03.437004Z info Opening status port 15020 2026-11-03T10:01:03.437841Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T10:01:03.439689Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T10:01:03.440706Z info Starting proxy agent 2026-11-03T10:01:03.440745Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T10:01:03.448452Z info sds Starting SDS grpc server 2026-11-03T10:01:03.448499Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T10:01:03.523947Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T10:01:03.587935Z info cache generated new workload certificate resourceName=default latency=149.053596ms ttl=23h59m59.412067949s 2026-11-03T10:01:03.587975Z info cache Root cert has changed, start rotating root cert 2026-11-03T10:01:03.588013Z info cache returned workload trust anchor from cache ttl=23h59m59.411987278s 2026-11-03T10:01:03.686712Z info ads ADS: new connection for node:1 2026-11-03T10:01:03.686802Z info cache returned workload trust anchor from cache ttl=23h59m59.313199881s 2026-11-03T10:01:03.686896Z info ads ADS: new connection for node:2 2026-11-03T10:01:03.686951Z info cache returned workload certificate from cache ttl=23h59m59.313050018s 2026-11-03T10:01:03.783772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:01:12.148628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:01:13.055311Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T10:01:13.962646Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T10:01:14.777075Z info Readiness succeeded in 11.348414062s 2026-11-03T10:01:14.777383Z info Envoy proxy is ready 2026-11-03T10:01:18.905182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:01:28.520933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:01:45.230433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:01:56.994762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:01:59.750576Z info ads ADS: new connection for node:3 2026-11-03T10:01:59.750743Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T10:01:59.750771Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T10:02:03.801352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:02:52.765600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:03:26.887617Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T10:03:27.176226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:03:32.012512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:03:48.937415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:07:09.430505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:07:41.330292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:08:10.728284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:08:26.378799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:08:43.254710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:08:55.734597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:09:00.909329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:09:04.039630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:09:04.039675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:09:04.039692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:09:04.039697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T10:09:03.968Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 71 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "41fd96aa-392b-421e-b077-c4580faaeb3c" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.248:57658 10.132.0.248:443 10.132.0.15:40942 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T10:09:20.450385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:10:18.443328Z info ads ADS: new connection for node:4 2026-11-03T10:10:18.448883Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T10:10:18.449000Z info cache read certificate from file resource=file-root:system 2026-11-03T10:10:21.943212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:10:24.788222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:11:09.055184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:11:09.055217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:11:09.055225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T10:11:09.055230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:11:09.055381Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T10:11:08.925Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1708 129 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "85443452-1cbe-4914-89b8-0dd2006970c1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.248:41228 10.132.0.248:443 10.132.0.15:53212 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T10:11:15.998058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:15.998100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:15.998112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:15.998117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T10:11:15.998323Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T10:11:15.877Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1706 121 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "a5c7fb11-1dcb-4dcd-9a85-b153673996ff" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.248:33396 10.132.0.248:443 10.132.0.15:56510 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T10:11:20.686084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:20.686116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:20.686125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T10:11:20.686129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T10:11:20.686294Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T10:11:20.509Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1706 176 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "b909d782-66d6-4c5c-bdd5-fe0b0557f9cf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.248:33396 10.132.0.248:443 10.132.0.15:56528 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T10:12:17.640918Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T10:12:17.686674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:12:18.010297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:12:18.010355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:12:18.010373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:12:18.010378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T10:12:18.257061Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T10:12:18.257087Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T10:12:18.257090Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T10:12:18.257094Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-03T10:12:17.891Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 119 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "45c911b8-35b1-41c2-9aa6-1dcee9877d8d" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.248:46888 10.132.0.248:443 10.132.0.15:48848 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T10:12:18.220Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 36 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c5638c39-701e-4f1a-947b-62451d013e51" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.248:443 10.132.0.15:48856 - v1-completions-path 2026-11-03T10:12:20.441529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:12:31.136092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:12:49.572804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:12:54.296177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T10:13:00.704Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "cd2352de-2a5d-4cb9-9cf9-4377d755fd96" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.248:443 10.132.0.15:46518 - v1-completions-path 2026-11-03T10:13:15.014642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:13:41.820307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:13:48.957855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T10:13:48.878Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 80 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "31419f5c-41df-46b1-8bf0-c2da631e090b" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:56292 10.132.0.248:443 10.132.0.15:51134 - v1-completions-path 2026-11-03T10:13:51.689987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-03T10:13:51.632Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "d1d74736-b0a5-4948-9faa-4d75c6a73d79" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:38216 10.132.0.248:443 10.132.0.15:48252 - v1-completions-path [2026-11-03T10:13:52.390Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2b8840ec-2cfa-48db-82f4-54401c71f1e9" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:38216 10.132.0.248:443 10.132.0.15:48260 - v1-completions-path [2026-11-03T10:13:52.646Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "b9a191c8-9338-4719-b77a-60f3932a0263" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:38216 10.132.0.248:443 10.132.0.15:48268 - v1-completions-path 2026-11-03T10:14:22.609726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:14:33.339598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:14:40.211616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T10:14:54.416Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "715f8ea3-fc2d-409e-aa2c-cdff1711b1ea" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:56292 10.132.0.248:443 10.132.0.15:58054 - v1-completions-path [2026-11-03T10:14:54.956Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "57148bf7-6339-44c7-9ee3-7a7bed7fe7da" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:38216 10.132.0.248:443 10.132.0.15:58058 - v1-completions-path 2026-11-03T10:15:11.261832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:15:16.005704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:15:28.148134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:15:38.520399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:16:05.110584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:16:15.963186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:16:33.954987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:16:36.756171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:16:36.756217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:16:36.756239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:16:36.756247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T10:16:36.620Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 135 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "5b728799-c3ce-4b4f-bbd1-9c63877e3f31" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.248:51510 10.132.0.248:443 10.132.0.15:45842 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T10:16:57.132Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 33 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "47308135-50e3-4ca2-aa45-da24cf95f412" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.248:443 10.132.0.15:39800 - v1-completions-path 2026-11-03T10:17:03.667009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:17:25.373553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:17:36.049109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:21:42.955318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T10:21:45.505Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 291 123 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "53bb5820-8170-4901-a993-4b05347bdce5" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:43036 10.132.0.248:443 10.132.0.15:39372 - v1-completions-path 2026-11-03T10:22:00.423028Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:22:05.137735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:22:07.786772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:22:07.786911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:22:07.786972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:22:07.787006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T10:22:05.960Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 1826 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2f7b21e9-93ef-41e9-b32f-f59c4b9e1afc" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.248:38154 10.132.0.248:443 10.132.0.15:56790 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T10:22:18.671972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:22:38.325820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:22:43.295696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T10:22:48.150Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "7ddc36b5-7056-49f1-b4f3-c1bfa0257050" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:38216 10.132.0.248:443 10.132.0.15:58742 - v1-completions-path 2026-11-03T10:23:03.285440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:23:13.943593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:23:20.348234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:23:35.758122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:23:35.758167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T10:23:35.758191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T10:23:35.758198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T10:23:35.646Z] "DELETE /v1/api-keys/2cccb6a5-4a08-4648-8719-63c6810207c6 HTTP/1.1" 200 - via_upstream - "-" 0 365 112 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "633beba8-5495-4c26-86f3-4cf0253fc5cd" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.248:40264 10.132.0.248:443 10.132.0.15:35860 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T10:23:49.338651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:23:55.856202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:24:01.851165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:24:34.268770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:24:44.833720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:24:51.479927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:24:57.514652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T10:25:05.828Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 66 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2525919d-cb41-4685-bb15-56b8a3e0131e" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:56292 10.132.0.248:443 10.132.0.15:44012 - v1-completions-path 2026-11-03T10:25:09.399114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T10:25:16.234Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 68 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "43de2db3-52db-44d9-9dcc-8fff352d985b" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:56292 10.132.0.248:443 10.132.0.15:38640 - v1-completions-path [2026-11-03T10:25:17.430Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "25b27205-ddb1-4847-9576-442aab9d3292" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:56292 10.132.0.248:443 10.132.0.15:38650 - v1-completions-path [2026-11-03T10:25:17.782Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "dfa77fad-2cba-4bf7-bc14-9294b399bc1a" "maas.apps.7fee51e1a8dedf3477d2.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.248:56292 10.132.0.248:443 10.132.0.15:38654 - v1-completions-path 2026-11-03T10:25:33.130808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:25:43.587220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:25:48.489414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:26:06.824032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:26:13.010695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:26:36.607804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:26:59.064200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:27:20.676351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:27:40.708465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:27:51.509966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:28:02.186585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:28:12.996440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:28:23.839298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T10:28:34.411390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9