2026-11-03T17:39:21.354507Z info FLAG: --concurrency="0" 2026-11-03T17:39:21.354529Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T17:39:21.354533Z info FLAG: --help="false" 2026-11-03T17:39:21.354535Z info FLAG: --log_as_json="false" 2026-11-03T17:39:21.354537Z info FLAG: --log_caller="" 2026-11-03T17:39:21.354539Z info FLAG: --log_output_level="default:info" 2026-11-03T17:39:21.354541Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T17:39:21.354545Z info FLAG: --log_target="[stdout]" 2026-11-03T17:39:21.354548Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T17:39:21.354550Z info FLAG: --outlierLogPath="" 2026-11-03T17:39:21.354552Z info FLAG: --profiling="true" 2026-11-03T17:39:21.354554Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T17:39:21.354556Z info FLAG: --proxyLogLevel="warning" 2026-11-03T17:39:21.354558Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T17:39:21.354560Z info FLAG: --stsPort="0" 2026-11-03T17:39:21.354562Z info FLAG: --templateFile="" 2026-11-03T17:39:21.354564Z info FLAG: --tokenManagerPlugin="" 2026-11-03T17:39:21.354566Z info FLAG: --vklog="0" 2026-11-03T17:39:21.354569Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T17:39:21.354740Z info Proxy role ips=[10.132.1.30] type=router id=maas-default-gateway-openshift-default-c9ffffc7f-6lq95.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T17:39:21.354791Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T17:39:21.355828Z info cpu limit detected as 2, setting concurrency 2026-11-03T17:39:21.356078Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T17:39:21.356090Z info JWT policy is third-party-jwt 2026-11-03T17:39:21.356093Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T17:39:21.357283Z info Starting default Istio SDS Server 2026-11-03T17:39:21.357306Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T17:39:21.357325Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T17:39:21.357954Z info Opening status port 15020 2026-11-03T17:39:21.358185Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T17:39:21.358656Z info sds Starting SDS grpc server 2026-11-03T17:39:21.358682Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T17:39:21.359782Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T17:39:21.362169Z info Starting proxy agent 2026-11-03T17:39:21.362198Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T17:39:21.425116Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T17:39:21.438688Z info cache generated new workload certificate resourceName=default latency=79.874383ms ttl=23h59m59.561315198s 2026-11-03T17:39:21.438733Z info cache Root cert has changed, start rotating root cert 2026-11-03T17:39:21.438763Z info cache returned workload trust anchor from cache ttl=23h59m59.561237141s 2026-11-03T17:39:21.536655Z info ads ADS: new connection for node:1 2026-11-03T17:39:21.536759Z info cache returned workload certificate from cache ttl=23h59m59.463242961s 2026-11-03T17:39:21.536989Z info ads ADS: new connection for node:2 2026-11-03T17:39:21.537066Z info cache returned workload trust anchor from cache ttl=23h59m59.462934747s 2026-11-03T17:39:21.621684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:39:29.619293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:39:30.559935Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T17:39:30.966415Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T17:39:31.638830Z info Readiness succeeded in 10.287070254s 2026-11-03T17:39:31.639212Z info Envoy proxy is ready 2026-11-03T17:39:58.108022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:01.008535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T17:40:01.008576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T17:40:01.008591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T17:40:01.008597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T17:40:00.915Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 304 93 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "6d292d0d-6bb2-40b6-83ce-5bf332749ccb" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.30:36552 10.132.1.30:443 10.132.0.10:41542 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:40:14.016748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:16.573228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:23.006200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:30.279544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:40.015856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:54.774398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:41:05.770352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:41:07.940629Z info ads ADS: new connection for node:3 2026-11-03T17:41:07.940835Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T17:41:07.940868Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T17:41:09.745994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:41:50.190563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:42:07.718Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 40 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "da42d367-2d58-455e-82fb-767b54ce4f95" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-39e7fadb-inference-pool-ip-afbec136.llm.svc.cluster.local - 10.132.1.30:443 10.132.0.10:36492 - v1-model-routing 2026-11-03T17:42:09.231602Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T17:42:09.300345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:42:12.663375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:42:19.788055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:44:28.870312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:44:28.870355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:44:28.870373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:44:28.870378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T17:44:28.791Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 79 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d9e7f4d6-93b8-4e9c-82d1-fd6e7789e56a" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.30:43938 10.132.1.30:443 10.132.0.10:39512 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:44:34.362382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:44:52.387052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:08.338123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:19.291126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:26.750149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:38.633868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:42.245118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:57.826729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:46:14.975Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 77 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "019cbb3f-7456-4d22-a0af-899296320388" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:57824 10.132.1.30:443 10.132.0.10:49224 - v1-completions-path [2026-11-03T17:46:29.107Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 66 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "4f978a63-a7d9-4df6-b539-17f7ce839beb" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:57170 10.132.1.30:443 10.132.0.10:39258 - v1-completions-path 2026-11-03T17:46:44.409133Z info ads ADS: new connection for node:4 2026-11-03T17:46:44.413420Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T17:46:44.413468Z info cache read certificate from file resource=file-root:system 2026-11-03T17:46:45.483749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:46:47.061561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:47:04.883378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:04.883412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:04.883422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:47:04.883426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:04.883578Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T17:47:04.768Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1711 115 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "a71121f4-4ae6-41ec-ba63-9584094c8095" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.30:51698 10.132.1.30:443 10.132.0.10:49028 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T17:48:03.252142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:48:03.252177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:48:03.252184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T17:48:03.252195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:48:03.252200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:48:03.252396Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T17:48:03.145Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1709 107 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e76e5621-aa96-4c18-9d18-2888c47ff83c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.30:51698 10.132.1.30:443 10.132.0.10:52210 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T17:48:09.613733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:48:09.613775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:48:09.613787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:48:09.613791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:48:09.613975Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T17:48:09.520Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1709 93 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f7a26552-7a68-483e-a8fe-aa86a78ed0e1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.30:51698 10.132.1.30:443 10.132.0.10:52214 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T17:48:25.198268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:48:25.317691Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T17:48:26.800332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:48:33.796191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:48:49.738193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:48:54.339164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:09.510482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:11.959266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:14.985391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:25.047512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:29.913180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:49:29.913221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:49:29.913239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:49:29.913246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T17:49:29.829Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 84 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "0bc4d389-a390-46bd-84f1-1162e736f527" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.30:44852 10.132.1.30:443 10.132.0.10:35260 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T17:49:30.479Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 73 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e4c37e52-d16a-4a3f-a63a-0eac4cb2520f" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41894 10.132.1.30:443 10.132.0.10:35278 - v1-completions-path 2026-11-03T17:49:31.687762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T17:49:30.673Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "1fa766dc-e448-4cb6-b19e-6f0eeccd9060" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41904 10.132.1.30:443 10.132.0.10:35294 - v1-completions-path [2026-11-03T17:49:31.197Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "a239b7bc-9475-4a61-bcd1-a8fa75baaf90" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41894 10.132.1.30:443 10.132.0.10:35306 - v1-completions-path [2026-11-03T17:49:31.630Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "014b858c-f19f-4e81-970c-18e1b903e419" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41904 10.132.1.30:443 10.132.0.10:35320 - v1-completions-path [2026-11-03T17:49:31.950Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "bd67e93e-518d-4e4f-bafb-edfdaf45c151" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41904 10.132.1.30:443 10.132.0.10:35328 - v1-completions-path 2026-11-03T17:49:48.216537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:58.574836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:03.084767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:50:07.226Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 82 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "a5b270d5-defc-44fb-9898-1d7acca72159" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41894 10.132.1.30:443 10.132.0.10:52798 - v1-completions-path [2026-11-03T17:50:07.652Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b7827975-cc71-4083-9b3b-c47e3671ebad" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41904 10.132.1.30:443 10.132.0.10:52802 - v1-completions-path 2026-11-03T17:50:19.942839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:22.288419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:29.359687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:41.282830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:46.427605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:54.807202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:59.924812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:51:06.241Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "c59d3509-e0f7-452b-93b2-c2bb5abe1bb0" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:57170 10.132.1.30:443 10.132.0.10:53692 - v1-completions-path 2026-11-03T17:51:18.278752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:51:21.309660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:51:34.958Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 38 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "8df4a42f-bf5e-405e-b0b0-541f4f49f499" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.30:443 10.132.0.10:54074 - v1-completions-path 2026-11-03T17:51:37.162586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:51:40.087119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:51:49.074578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:51:54.530Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "c6edf574-735b-467f-969c-8b13f08df78a" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41894 10.132.1.30:443 10.132.0.10:33682 - v1-completions-path 2026-11-03T17:52:06.792934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:52:17.151813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:52:34.651427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:52:38.019729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:54:57.138166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:55:00.608468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:56:25.522058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:56:40.976932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:56:43.376208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:56:50.742832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:07.541456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:10.591362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:26.048087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:37.200434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:41.829354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:57:45.892Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b328a198-9c6d-4d4f-8cfd-798b3b18e4f8" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41904 10.132.1.30:443 10.132.0.10:47160 - v1-completions-path 2026-11-03T17:57:46.790577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T17:57:46.790612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T17:57:46.790627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T17:57:46.790631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T17:57:46.709Z] "DELETE /v1/api-keys/d2b9c872-0e94-4937-befb-590eec0c473c HTTP/1.1" 200 - via_upstream - "-" 0 365 81 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "8eec2ab3-a9cf-436a-aab5-8094159b08df" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.133.0.219:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.30:37778 10.132.1.30:443 10.132.0.10:47174 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:57:58.849156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:03.598915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:08.804035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:58:14.783Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 70 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "9b6a922d-5564-448d-a53a-51bbee48c70e" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41904 10.132.1.30:443 10.132.0.10:38148 - v1-completions-path 2026-11-03T17:58:31.691150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:41.946792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:46.497741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:49.475921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:52.474434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:58:56.908Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b0bdae95-7f0a-495c-850d-dcfda81e924c" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:41904 10.132.1.30:443 10.132.0.10:53558 - v1-completions-path 2026-11-03T17:59:09.864951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:20.371998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:22.553970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:30.869540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:34.556510Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:52.629885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:55.032774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:13.294931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:23.668971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:33.974833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:44.384587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:54.740113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:05.136833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:15.631957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:25.870817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:36.247195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:46.568423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T18:01:49.157Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 76 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "491af840-2156-4e6e-8178-19da6e995164" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.30:57170 10.132.1.30:443 10.132.0.10:43510 - v1-completions-path 2026-11-03T18:01:51.325778Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T18:01:51.325802Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T18:01:51.325805Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T18:01:51.325809Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T18:01:51.299Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 26 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "ca6b7029-a9c7-4912-a25e-e2c384009be7" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.30:443 10.132.0.10:43514 - v1-completions-path