2026-11-03T21:38:46.590117Z info FLAG: --concurrency="0" 2026-11-03T21:38:46.590137Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T21:38:46.590141Z info FLAG: --help="false" 2026-11-03T21:38:46.590143Z info FLAG: --log_as_json="false" 2026-11-03T21:38:46.590145Z info FLAG: --log_caller="" 2026-11-03T21:38:46.590147Z info FLAG: --log_output_level="default:info" 2026-11-03T21:38:46.590149Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T21:38:46.590154Z info FLAG: --log_target="[stdout]" 2026-11-03T21:38:46.590156Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T21:38:46.590158Z info FLAG: --outlierLogPath="" 2026-11-03T21:38:46.590160Z info FLAG: --profiling="true" 2026-11-03T21:38:46.590162Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T21:38:46.590164Z info FLAG: --proxyLogLevel="warning" 2026-11-03T21:38:46.590167Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T21:38:46.590169Z info FLAG: --stsPort="0" 2026-11-03T21:38:46.590170Z info FLAG: --templateFile="" 2026-11-03T21:38:46.590172Z info FLAG: --tokenManagerPlugin="" 2026-11-03T21:38:46.590175Z info FLAG: --vklog="0" 2026-11-03T21:38:46.590178Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T21:38:46.590337Z info Proxy role ips=[10.132.0.56] type=router id=maas-default-gateway-openshift-default-75d7c785f-8b9jr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T21:38:46.590387Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T21:38:46.591626Z info cpu limit detected as 2, setting concurrency 2026-11-03T21:38:46.591893Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T21:38:46.591903Z info JWT policy is third-party-jwt 2026-11-03T21:38:46.591906Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T21:38:46.593778Z info Starting default Istio SDS Server 2026-11-03T21:38:46.593806Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T21:38:46.593829Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T21:38:46.594395Z info Opening status port 15020 2026-11-03T21:38:46.595478Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T21:38:46.596166Z info sds Starting SDS grpc server 2026-11-03T21:38:46.596184Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T21:38:46.597488Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T21:38:46.598423Z info Starting proxy agent 2026-11-03T21:38:46.598454Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T21:38:46.665373Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T21:38:46.774473Z info ads ADS: new connection for node:1 2026-11-03T21:38:46.774950Z info ads ADS: new connection for node:2 2026-11-03T21:38:46.828635Z info cache generated new workload certificate resourceName=default latency=232.218912ms ttl=23h59m59.171370246s 2026-11-03T21:38:46.828690Z info cache Root cert has changed, start rotating root cert 2026-11-03T21:38:46.828739Z info cache returned workload trust anchor from cache ttl=23h59m59.171262265s 2026-11-03T21:38:46.828765Z info cache returned workload certificate from cache ttl=23h59m59.171236436s 2026-11-03T21:38:46.828859Z info cache returned workload trust anchor from cache ttl=23h59m59.171143918s 2026-11-03T21:38:46.829227Z info cache returned workload trust anchor from cache ttl=23h59m59.170774276s 2026-11-03T21:38:46.873454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:38:53.189692Z info Readiness succeeded in 6.60241732s 2026-11-03T21:38:53.190003Z info Envoy proxy is ready 2026-11-03T21:39:27.302195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:29.385504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:35.001276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:37.738219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:39.632417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:42.047124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:45.957647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:40:11.840331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:40:18.660456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:40:19.846793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:41:24.049557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:41:24.049600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:41:24.049616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:41:24.049623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T21:41:23.976Z] "DELETE /v1/api-keys/938d4f88-1c8c-48d3-92e8-1bb92b664e2e HTTP/1.1" 200 - via_upstream - "-" 0 365 73 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "8071366e-b381-41d2-b9c4-254bfb2f2cc6" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:51336 10.132.0.56:443 10.132.0.9:40386 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:44:06.901423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:06.901458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:06.901470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:06.901475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T21:44:07.385052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:07.385084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:07.385096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:07.385101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T21:44:06.707Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 194 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "59d0df5c-ebdb-4c01-acca-1f1988b81910" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:35654 10.132.0.56:443 10.132.0.9:33254 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:44:07.310Z] "DELETE /v1/api-keys/da0d35cb-f784-4147-a2d0-4e38c3361341 HTTP/1.1" 200 - via_upstream - "-" 0 321 74 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "999c4706-3727-4783-a263-35b62c1d31d4" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:35654 10.132.0.56:443 10.132.0.9:33258 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:44:26.454872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:44:43.318841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:21.848045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:45.812911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:50:30.591970Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:50:30.591997Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:50:30.592000Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:50:30.592003Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T21:50:30.551Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 40 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3b22a3b4-5280-4c38-8e0d-c43428738056" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.9:33986 - v1-completions-path 2026-11-03T21:50:35.719555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:50:40.749Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 54 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ea8f0f13-095f-4fdb-9c70-a00c10d2ca85" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.9:58252 - v1-completions-path 2026-11-03T21:50:52.748733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:50:57.502803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:51:16.025604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:51:32.087613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:51:43.594Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 74 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "dda1b258-6721-4167-b78c-2800ab8ee620" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:58694 10.132.0.56:443 10.132.0.9:38292 - v1-completions-path 2026-11-03T21:52:01.071194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:52:11.553647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:52:15.995245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:52:23.157Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "42921da9-f81c-44bd-a74a-f1c9ed4a8e42" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:43080 10.132.0.56:443 10.132.0.9:36848 - v1-completions-path 2026-11-03T21:52:23.541160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T21:52:23.485Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "40b96dbb-acc4-4316-a596-5fe725b726d7" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:43080 10.132.0.56:443 10.132.0.9:36862 - v1-completions-path 2026-11-03T21:52:35.999482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:52:38.395203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:52:56.753931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:53:01.175768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:53:18.368Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 73 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "fb0e452f-359a-43eb-82e0-6a1545950f68" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:45404 10.132.0.56:443 10.132.0.9:53234 - v1-completions-path 2026-11-03T21:53:19.962324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:53:22.364531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:53:40.009684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:01.599053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:05.453428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:24.904243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:27.925439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:54:35.183Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 35 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "77e0d84e-e03a-4eaf-8b33-3b1b4bbfafbc" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.9:49936 - v1-completions-path 2026-11-03T21:54:40.680922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:54:46.346Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4896ad63-54ef-4419-adbe-1d114ac7c2ba" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:43080 10.132.0.56:443 10.132.0.9:48652 - v1-completions-path 2026-11-03T21:54:58.556305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:55:08.884547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:55:28.923196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:55:32.487798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:57:14.665241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:57:18.236931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:58:47.631759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:59:02.972064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:59:05.491766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:59:12.081300Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:59:12.081325Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:59:12.081328Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:59:12.081332Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T21:59:12.049Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 31 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3ddd7c86-eaf4-44b9-a827-c3b7a790fab3" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.9:50556 - v1-completions-path 2026-11-03T21:59:24.141987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:00:59.390337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:00:59.390368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:00:59.390379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:00:59.390384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T22:00:59.337Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 53 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "8d271c4c-9be5-4205-8e25-074841d5bc0e" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:59130 10.132.0.56:443 10.132.0.9:38324 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:01:05.302690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:01:20.917609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:01:36.528200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:01:36.528235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:01:36.528252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:01:36.528257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T22:01:36.664449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:01:36.476Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 52 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "23235b59-88de-46c3-891c-5e2cd263f20d" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:59130 10.132.0.56:443 10.132.0.9:50122 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:01:50.589620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:01:56.026884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:02:10.592810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:02:24.121566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:02:28.477199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:02:28.477238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:02:28.477256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:02:28.477262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T22:02:28.401Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 75 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "bd54960f-07b0-4d34-b4aa-799a4a446426" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:43810 10.132.0.56:443 10.132.0.9:41608 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:02:40.945002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:05:39.599329Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T22:05:39.599354Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T22:05:39.599358Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T22:05:39.599362Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T22:05:39.521Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 78 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "666b9d72-a0f6-40e2-ae2f-6794efdcb149" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.9:37560 - v1-catch-all-path 2026-11-03T22:05:42.179976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:05:50.302640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:06:08.230597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:06:10.647446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:06:13.537025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T22:06:13.609075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:06:13.609109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:06:13.609122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:06:13.609127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T22:06:13.526Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 82 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f2f9db15-2f4f-46b3-8f93-0e9e7ec9a460" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.134.0.92:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:34696 10.132.0.56:443 10.132.0.9:51356 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:06:24.398400Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T22:06:25.792425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:06:36.642814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8