2026-11-03T01:20:32.949830Z info FLAG: --concurrency="0" 2026-11-03T01:20:32.950024Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T01:20:32.950062Z info FLAG: --help="false" 2026-11-03T01:20:32.950087Z info FLAG: --log_as_json="false" 2026-11-03T01:20:32.950110Z info FLAG: --log_caller="" 2026-11-03T01:20:32.950133Z info FLAG: --log_output_level="default:info" 2026-11-03T01:20:32.950155Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T01:20:32.950216Z info FLAG: --log_target="[stdout]" 2026-11-03T01:20:32.950240Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T01:20:32.950262Z info FLAG: --outlierLogPath="" 2026-11-03T01:20:32.950282Z info FLAG: --profiling="true" 2026-11-03T01:20:32.950302Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T01:20:32.950321Z info FLAG: --proxyLogLevel="warning" 2026-11-03T01:20:32.950342Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T01:20:32.950364Z info FLAG: --stsPort="0" 2026-11-03T01:20:32.950386Z info FLAG: --templateFile="" 2026-11-03T01:20:32.950409Z info FLAG: --tokenManagerPlugin="" 2026-11-03T01:20:32.950434Z info FLAG: --vklog="0" 2026-11-03T01:20:32.950457Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T01:20:32.950691Z info Proxy role ips=[10.133.0.140] type=router id=maas-default-gateway-openshift-default-596dc9545f-46hnd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T01:20:32.950791Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T01:20:32.953104Z info cpu limit detected as 2, setting concurrency 2026-11-03T01:20:32.955591Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T01:20:32.955678Z info JWT policy is third-party-jwt 2026-11-03T01:20:32.955711Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T01:20:32.959725Z info Opening status port 15020 2026-11-03T01:20:32.959750Z info Starting default Istio SDS Server 2026-11-03T01:20:32.959774Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T01:20:32.959797Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T01:20:32.960739Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T01:20:32.963238Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T01:20:32.964532Z info Starting proxy agent 2026-11-03T01:20:32.964616Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T01:20:32.967353Z info sds Starting SDS grpc server 2026-11-03T01:20:32.967421Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T01:20:33.072232Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T01:20:33.193585Z info cache generated new workload certificate resourceName=default latency=232.664646ms ttl=23h59m59.806420656s 2026-11-03T01:20:33.193644Z info cache Root cert has changed, start rotating root cert 2026-11-03T01:20:33.193687Z info cache returned workload trust anchor from cache ttl=23h59m59.806314744s 2026-11-03T01:20:33.320690Z info ads ADS: new connection for node:1 2026-11-03T01:20:33.326409Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T01:20:33.326465Z info cache read certificate from file resource=file-root:system 2026-11-03T01:20:33.371771Z info ads ADS: new connection for node:2 2026-11-03T01:20:33.371859Z info cache returned workload certificate from cache ttl=23h59m59.628143541s 2026-11-03T01:20:33.372763Z info ads ADS: new connection for node:3 2026-11-03T01:20:33.372849Z info cache returned workload trust anchor from cache ttl=23h59m59.627152745s 2026-11-03T01:20:33.490218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:20:45.172453Z warn xdsproxy sendDownstreamDelta took 10.58577491s 2026-11-03T01:20:45.304985Z info Readiness succeeded in 12.357319666s 2026-11-03T01:20:45.305494Z info Envoy proxy is ready 2026-11-03T01:20:56.864234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:21:31.419432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:21:52.730096Z info ads ADS: new connection for node:4 2026-11-03T01:21:52.730416Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:21:52.730504Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:21:55.247175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:22:06.428453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:22:06.428492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:22:06.428503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:22:06.428507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T01:22:06.428698Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T01:22:06.278Z] "POST /anything/e2e-dft-44821e-3c70c2 HTTP/1.1" 200 - via_upstream - "-" 109 1772 149 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "1979cd36-e69a-45c3-bc23-73c6ef1f369d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.140:40554 10.133.0.140:443 10.132.0.9:47792 - llm.external-model-e2e-dft-44821e-613a0b3f174b.0 2026-11-03T01:22:18.093712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:22:35.498651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:25:45.949468Z info ads ADS: "" 4 terminated 2026-11-03T01:26:46.602447Z info ads ADS: "" 1 terminated 2026-11-03T01:29:04.572908Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:30:05.875095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:34:49.535540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:36:34.830865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:44:16.721007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:44:39.516719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:45:14.323041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T01:45:15.057Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 2817 3089 1807 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "057949ce-38d7-44e5-943d-a375dbce3a65" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:33880 10.133.0.140:443 10.132.0.9:45336 - v1-chat-completions-path [2026-11-03T01:45:17.343Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 68 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5586c70b-39dd-47d0-b132-672c3c8693bf" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:33880 10.133.0.140:443 10.132.0.9:45354 - v1-chat-completions-path 2026-11-03T01:45:29.400719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:45:31.215860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:45:34.290216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-03T01:45:34.647844Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-03T01:45:34.214Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 28720 3466266 458 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ee0e86f3-a598-4260-b025-c8ae38df99c6" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:42066 10.133.0.140:443 10.132.0.9:60094 - v1-catch-all-path 2026-11-03T01:45:37.029268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:45:40.181828Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-03T01:45:40.120Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 61 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b04a9cfd-7eb0-4c1f-a0e7-d673924748ad" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:42066 10.133.0.140:443 10.132.0.9:36652 - v1-catch-all-path 2026-11-03T01:45:40.425745Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T01:45:40.339Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 85 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "7c337a44-6144-433c-b830-59a6fe9bff40" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:42078 10.133.0.140:443 10.132.0.9:36668 - v1-catch-all-path 2026-11-03T01:45:52.081590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:45:53.620335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:45:58.882602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:46:18.962920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:46:20.799901Z info ads ADS: new connection for node:5 2026-11-03T01:46:20.800210Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:46:21.577118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:47:02.815291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T01:47:07.327Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 333 89 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "1867fb96-073b-4590-a836-9c41114184e9" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.1.107:8000" outbound|54321||e2e-prio-pool-55b7e383-inference-pool-ip-b446f665.llm.svc.cluster.local 10.133.0.140:57492 10.133.0.140:443 10.132.0.9:32952 - v1-model-routing [2026-11-03T01:47:08.364Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 343 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "63a43b47-b44a-41ad-b48c-077874176696" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.1.107:8000" outbound|54321||e2e-prio-pool-55b7e383-inference-pool-ip-b446f665.llm.svc.cluster.local 10.133.0.140:57498 10.133.0.140:443 10.132.0.9:32958 - v1-model-routing 2026-11-03T01:47:21.299610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:47:21.684953Z info ads ADS: "" 5 terminated 2026-11-03T01:47:23.075523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:47:25.783015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:47:29.536475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:49:44.163546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:49:44.163593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:49:44.163608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:49:44.163613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T01:49:44.101Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 61 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "55a22e65-7d2d-415d-98ba-966d2e5738c1" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.140:51810 10.133.0.140:443 10.132.0.9:48600 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:49:50.731287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:50:03.910522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:50:18.935701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:50:18.935756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:50:18.935779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:50:18.935785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T01:50:18.876Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 59 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "0259d4a2-ddc9-4cce-aae4-fb0e61525f37" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.140:33050 10.133.0.140:443 10.132.0.9:35548 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:50:20.028357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:50:31.806538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:50:34.698337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:50:34.698369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:50:34.698382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T01:50:34.698387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:50:35.174775Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T01:50:32.740Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 1958 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5f1b13db-f341-9b94-92ef-b187f608ff77" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.140:51810 10.133.0.140:443 10.132.0.9:34738 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:50:46.179717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:50:48.023225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T01:50:51.272Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "8de1c689-bdb6-4a60-a275-bc116e102c60" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.140:443 10.132.0.9:46864 - v1-completions-path 2026-11-03T01:51:02.995873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:51:04.510942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T01:51:04.451Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 79 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "dbbcd560-2038-47d1-9e2b-e65b013e40b2" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:37620 10.133.0.140:443 10.132.0.9:43650 - v1-completions-path 2026-11-03T01:51:48.320610Z info ads ADS: new connection for node:6 2026-11-03T01:51:48.325892Z info cache read certificate from file resource=file-root:system 2026-11-03T01:51:48.804992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:51:50.103272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:52:18.998717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:18.998750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:18.998764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:52:18.998769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:18.998947Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T01:52:18.867Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 131 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b2cc10d1-7e37-43ae-8ad1-4bb65d34988a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.140:45068 10.133.0.140:443 10.132.0.9:55716 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:52:25.503320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:52:25.503352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:52:25.503363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:52:25.503367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T01:52:25.503524Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T01:52:25.378Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 124 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "d3816885-416c-4f5f-9731-3fd77d073f8e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.140:38124 10.133.0.140:443 10.132.0.9:47452 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:52:34.180728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:34.180761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:34.180771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:34.180775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:52:34.180932Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T01:52:34.078Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 102 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e8b213d0-b874-4477-bb2d-49c0c625c19e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.140:45068 10.133.0.140:443 10.132.0.9:43972 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:52:53.680477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:53.680512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:53.680524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:52:53.680529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:52:53.680698Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T01:52:53.578Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1709 102 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "2779a2fc-e478-4351-9d9c-8493749b3f46" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.140:45068 10.133.0.140:443 10.132.0.9:56684 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:53:04.289105Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T01:53:28.225429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:53:28.403022Z info ads ADS: "" 6 terminated 2026-11-03T01:53:28.846509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:53:31.516105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:53:34.589803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:53:46.864496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:53:48.434895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:54:03.302268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:54:04.905461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:54:07.703295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:54:15.962209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T01:54:24.459Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 74 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "d273b39a-30e2-487e-b16b-4f4e8deedd07" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:47034 10.133.0.140:443 10.132.0.9:38072 - v1-completions-path 2026-11-03T01:54:40.386546Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:54:50.581010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:54:52.239822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T01:54:58.189Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "0a627f0f-7c99-4957-b19d-e388e25df95a" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:57898 10.133.0.140:443 10.132.0.9:51854 - v1-completions-path 2026-11-03T01:55:11.267383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:55:12.958317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:55:27.462281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:55:29.482951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:55:35.042957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:55:43.719702Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:55:57.600230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:56:08.243080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:56:10.677719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:56:25.402525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:56:27.436746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:56:28.166368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:56:28.166402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:56:28.166415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:56:28.166420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T01:56:28.103Z] "DELETE /v1/api-keys/fb43526f-4adb-4227-9b50-04e4161146be HTTP/1.1" 404 - via_upstream - "-" 0 29 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "fcfa7527-c831-4b8b-9c2e-f448a225aa81" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.140:55732 10.133.0.140:443 10.132.0.9:57162 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:56:31.738865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:56:38.417016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:56:38.417051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:56:38.417067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T01:56:38.417072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T01:56:38.358Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 58 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "05232b68-4956-4514-9fb7-fb85c87ccd02" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.140:49454 10.133.0.140:443 10.132.0.9:44660 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T01:56:38.598Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c3ef30a7-a44b-412d-96c9-c71aba77324e" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:47034 10.133.0.140:443 10.132.0.9:44662 - v1-completions-path 2026-11-03T01:56:50.213332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:57:00.514901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:59:36.934497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T01:59:39.177507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:00:42.012289Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T02:00:42.012313Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T02:00:42.012316Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T02:00:42.012320Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T02:00:41.965Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 46 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "27da5bb4-8613-4827-a79f-e1dfdbc586b5" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.140:443 10.132.0.9:34074 - v1-completions-path 2026-11-03T02:01:02.974146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:01:17.762653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:01:19.343153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:01:34.128754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:01:43.580003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:01:47.395859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:01:47.395893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:01:47.395909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:01:47.395913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T02:01:47.404285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T02:01:47.286Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 109 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "4401bdfc-4001-4623-88a6-3619e5c074bc" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.134.1.171:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.140:46610 10.133.0.140:443 10.132.0.9:55836 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T02:01:50.099Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e518c86f-2a8d-406e-93e9-1d8bd0d35bec" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:47034 10.133.0.140:443 10.132.0.9:38680 - v1-completions-path 2026-11-03T02:02:02.579937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:02:13.241806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:02:16.217242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T02:02:20.847Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "15022f63-ce77-4a1d-918c-9cc9109e6b81" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:57898 10.133.0.140:443 10.132.0.9:51658 - v1-completions-path [2026-11-03T02:02:21.863Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "366ef19e-1290-4042-a6e3-790ca1cac4f2" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.140:443 10.132.0.9:51666 - v1-completions-path 2026-11-03T02:02:33.794617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:02:35.891698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:02:38.910330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T02:02:43.409Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "f6fc4a6f-d244-4fa3-8603-514962ad5ace" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:57898 10.133.0.140:443 10.132.0.9:37852 - v1-completions-path [2026-11-03T02:02:47.311Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 66 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b59df7f6-e2be-43a9-a984-7ecf064c21db" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:47034 10.133.0.140:443 10.132.0.9:37868 - v1-completions-path 2026-11-03T02:03:00.061942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:03:10.444698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:03:13.396018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:03:15.909098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:03:20.352210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T02:03:24.007Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 68 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ec5cb955-e0f4-4b37-a6b3-811607b6f474" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:57898 10.133.0.140:443 10.132.0.9:46046 - v1-completions-path 2026-11-03T02:03:36.899975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:03:47.061632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:03:48.668847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:03:55.890155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:03:59.132009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:04:14.792680Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:04:34.717746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:04:44.889480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:04:55.173284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:05:05.315303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:05:15.585539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:05:25.776947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:05:35.963245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:05:46.237592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:05:56.473526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:06:06.584749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:06:08.417326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:06:08.417372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:06:08.417393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:06:08.417400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T02:06:08.310Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 107 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "cd1f5b56-df5d-4e37-b7d9-c11936ec8972" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.134.1.171:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.140:56732 10.133.0.140:443 10.132.0.9:51476 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T02:06:13.613Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 84 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c8c0473b-a420-4411-85bd-679da8e27f10" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.140:37620 10.133.0.140:443 10.132.0.9:55096 - v1-completions-path