2026-11-03T14:56:12.193013Z info FLAG: --concurrency="0" 2026-11-03T14:56:12.193037Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T14:56:12.193043Z info FLAG: --help="false" 2026-11-03T14:56:12.193047Z info FLAG: --log_as_json="false" 2026-11-03T14:56:12.193050Z info FLAG: --log_caller="" 2026-11-03T14:56:12.193053Z info FLAG: --log_output_level="default:info" 2026-11-03T14:56:12.193056Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T14:56:12.193063Z info FLAG: --log_target="[stdout]" 2026-11-03T14:56:12.193067Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T14:56:12.193070Z info FLAG: --outlierLogPath="" 2026-11-03T14:56:12.193073Z info FLAG: --profiling="true" 2026-11-03T14:56:12.193076Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T14:56:12.193079Z info FLAG: --proxyLogLevel="warning" 2026-11-03T14:56:12.193083Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T14:56:12.193086Z info FLAG: --stsPort="0" 2026-11-03T14:56:12.193090Z info FLAG: --templateFile="" 2026-11-03T14:56:12.193092Z info FLAG: --tokenManagerPlugin="" 2026-11-03T14:56:12.193095Z info FLAG: --vklog="0" 2026-11-03T14:56:12.193097Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T14:56:12.193283Z info Proxy role ips=[10.134.1.228] type=router id=maas-default-gateway-openshift-default-76f4876667-2lvkf.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T14:56:12.193341Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T14:56:12.194461Z info cpu limit detected as 2, setting concurrency 2026-11-03T14:56:12.195076Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T14:56:12.195088Z info JWT policy is third-party-jwt 2026-11-03T14:56:12.195091Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T14:56:12.196587Z info Starting default Istio SDS Server 2026-11-03T14:56:12.196613Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T14:56:12.196641Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T14:56:12.197182Z info Opening status port 15020 2026-11-03T14:56:12.198013Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T14:56:12.198590Z info sds Starting SDS grpc server 2026-11-03T14:56:12.198611Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T14:56:12.199391Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T14:56:12.200210Z info Starting proxy agent 2026-11-03T14:56:12.200242Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T14:56:12.278478Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T14:56:12.308291Z info cache generated new workload certificate resourceName=default latency=109.560545ms ttl=23h59m59.691712284s 2026-11-03T14:56:12.308327Z info cache Root cert has changed, start rotating root cert 2026-11-03T14:56:12.308360Z info cache returned workload trust anchor from cache ttl=23h59m59.691640848s 2026-11-03T14:56:12.394707Z info ads ADS: new connection for node:1 2026-11-03T14:56:12.394772Z info cache returned workload certificate from cache ttl=23h59m59.605229321s 2026-11-03T14:56:12.395552Z info ads ADS: new connection for node:2 2026-11-03T14:56:12.395647Z info cache returned workload trust anchor from cache ttl=23h59m59.604354622s 2026-11-03T14:56:12.488552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:56:20.714540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:56:21.618051Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T14:56:21.817521Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T14:56:23.219042Z info Readiness succeeded in 11.029462287s 2026-11-03T14:56:23.219422Z info Envoy proxy is ready 2026-11-03T14:56:40.483491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:56:52.712219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T14:56:52.712425Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T14:56:52.609Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 165 503 102 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "7d3d8d59-db75-4594-89b4-6bbbdaf5f1c3" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:33454 10.134.1.228:443 10.132.0.13:59742 - v1-model-routing 2026-11-03T14:56:52.835621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:56:52.835678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:56:52.835711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T14:56:52.835719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:56:52.835943Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T14:56:52.775Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 181 2336 60 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "792f3fc0-09bc-48aa-b4c9-9439f7419b79" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:33454 10.134.1.228:443 10.132.0.13:59748 - v1-model-routing 2026-11-03T14:56:53.416869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:57:05.854952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:57:05.854986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:57:05.854997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:57:05.855002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T14:57:05.855185Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T14:57:05.785Z] "POST /v1/messages HTTP/1.1" 404 - via_upstream - "-" 165 9 70 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "453e38f6-3ea6-41aa-a49c-69364644df64" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:48310 10.134.1.228:443 10.132.0.13:55032 - v1-model-routing 2026-11-03T14:57:16.114026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:57:16.114059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:57:16.114069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:57:16.114073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T14:57:16.114240Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T14:57:16.051Z] "POST /v1/messages HTTP/1.1" 404 - via_upstream - "-" 165 9 62 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "c79d5f16-127b-4c5c-8d56-a0634aa2be3a" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:48310 10.134.1.228:443 10.132.0.13:52356 - v1-model-routing 2026-11-03T14:57:34.250128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:57:49.846210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:57:51.537211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:57:54.378947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:57:54.378984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:57:54.379000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T14:57:54.379005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T14:57:54.261Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 117 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "c86ffd19-114c-472c-b67a-2cd044f2bb91" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.228:57794 10.134.1.228:443 10.132.0.13:49180 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:57:57.592310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:58:13.011054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:58:14.710834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:58:29.431714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:58:40.306797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:58:42.112583Z info ads ADS: new connection for node:3 2026-11-03T14:58:42.113018Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T14:58:42.113130Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T14:58:44.932496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:59:24.428120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:59:43.231898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:59:43.706943Z info ads ADS: "" 3 terminated 2026-11-03T14:59:45.271365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:59:48.267888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:59:52.351040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:02:07.077897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:02:24.066258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:02:39.937461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:02:51.629414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:02:55.319047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:03:03.767045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:03:06.269041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:03:21.567149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:04:06.718611Z info ads ADS: new connection for node:4 2026-11-03T15:04:06.729771Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T15:04:06.730108Z info cache read certificate from file resource=file-root:system 2026-11-03T15:04:07.235416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:04:08.945572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:05:10.943106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:10.943138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:10.943148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:10.943153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:05:10.943317Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T15:05:10.813Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 130 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "dbd9e928-5fd0-4696-9c66-cc31283dec9c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.228:34714 10.134.1.228:443 10.132.0.13:43040 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:05:23.954987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T15:05:23.955401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:23.955435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:23.955451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:23.955458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:05:23.955661Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T15:05:23.855Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 100 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "75248ba1-54b0-410d-ac11-6d6885ec3c28" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.228:34714 10.134.1.228:443 10.132.0.13:55286 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:05:28.277560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:28.277596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:28.277607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:05:28.277612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:05:28.277779Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T15:05:28.178Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 99 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "d36d7555-37ba-48e4-a65a-9a6ae6581a8f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.228:34714 10.134.1.228:443 10.132.0.13:55298 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:05:45.817100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:05:45.983041Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T15:05:46.473898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:05:49.443951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:05:51.632244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:05:54.814Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 77 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "6543342d-6545-414a-bcb1-1cd6b1290b5e" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:45108 10.134.1.228:443 10.132.0.13:60772 - v1-completions-path 2026-11-03T15:06:07.334425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:06:09.041521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:06:23.869040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:06:25.686237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:06:28.842679Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:06:37.326646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:06:43.489Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "8a5ab6f8-bcb7-49a1-8d8d-e12d074c2ee9" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:45108 10.134.1.228:443 10.132.0.13:57170 - v1-completions-path [2026-11-03T15:06:44.083Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "6aa32650-75d6-436b-ac40-c4b8e7beb304" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:45108 10.134.1.228:443 10.132.0.13:57174 - v1-completions-path [2026-11-03T15:06:46.388Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "9078a4f4-c331-412e-b5f0-ee2cf676606b" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:45108 10.134.1.228:443 10.132.0.13:57188 - v1-completions-path 2026-11-03T15:07:01.979652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:07:12.239209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:07:14.598555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:07:20.583Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 64 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "8d6adb1b-0817-4de6-869b-39bc888304ec" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:49002 10.134.1.228:443 10.132.0.13:34456 - v1-completions-path 2026-11-03T15:07:33.294276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:07:35.089267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:07:40.793618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:07:51.784795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:05.502954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:07.341560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:12.889887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:30.731451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:33.648620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:48.057604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:49.704419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:55.484647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:58.542477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:08:58.542515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:08:58.542532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:08:58.542538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T15:08:58.448Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 94 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "8801b744-a9b2-4e5c-a849-c20a9a183716" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.228:56134 10.134.1.228:443 10.132.0.13:57982 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:09:10.619117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:09:20.987119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:09:37.036919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:09:39.505649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:11:24.453259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:11:26.817322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:12:48.338417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:13:03.460729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:13:05.265466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:13:20.376210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:13:30.220716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:13:34.444045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:13:38.169409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T15:13:38.163Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "603980d0-6e60-4dad-b3e7-23c48507ed7b" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:49002 10.134.1.228:443 10.132.0.13:58020 - v1-completions-path [2026-11-03T15:13:38.386Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "d8e00f16-eb39-4d84-86e7-698a3702ef23" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:45108 10.134.1.228:443 10.132.0.13:58032 - v1-completions-path [2026-11-03T15:13:38.716Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "3d721633-ed06-4cc6-a7fe-855870999ed2" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:45108 10.134.1.228:443 10.132.0.13:58038 - v1-completions-path 2026-11-03T15:13:49.639766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:00.084195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:03.261934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:20.041032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:22.124044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:25.258620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:14:29.172Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "3849b250-1d76-413b-a3e8-d817892d6afc" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:45108 10.134.1.228:443 10.132.0.13:53826 - v1-completions-path [2026-11-03T15:14:29.302Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "569cb94d-211f-40ba-967d-a44a60d3e2d9" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:49002 10.134.1.228:443 10.132.0.13:53834 - v1-completions-path [2026-11-03T15:14:30.954Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "bc3010f2-1003-4a20-b320-8ed399bafdef" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:49002 10.134.1.228:443 10.132.0.13:53860 - v1-completions-path 2026-11-03T15:14:46.411265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:56.628211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:59.006336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:02.200363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:15:05.795Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "01efefb6-7c54-43d8-a0e8-575e26bacc38" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:45108 10.134.1.228:443 10.132.0.13:53174 - v1-completions-path 2026-11-03T15:15:07.371883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:23.672159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:33.966753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:35.637227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:42.817824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:45.785518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:49.038262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:16:06.143039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:16:26.200177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:16:36.309966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:16:46.543738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:16:56.825668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:07.039928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:17.246878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:27.557676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:37.733348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:47.987588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:58.169790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:18:00.976Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 80 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "b8c048ad-7baf-44b4-bfe9-aa4b32eec0c4" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:48310 10.134.1.228:443 10.132.0.13:39164 - v1-completions-path [2026-11-03T15:18:05.608Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 75 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "19c2766a-fda6-434a-9d9b-f716c5111c23" "maas.apps.d1482ea4acbc5dab920b.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.228:33454 10.134.1.228:443 10.132.0.13:39208 - v1-completions-path