2026-11-01T20:52:56.313491Z info FLAG: --concurrency="0" 2026-11-01T20:52:56.313511Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T20:52:56.313516Z info FLAG: --help="false" 2026-11-01T20:52:56.313518Z info FLAG: --log_as_json="false" 2026-11-01T20:52:56.313520Z info FLAG: --log_caller="" 2026-11-01T20:52:56.313522Z info FLAG: --log_output_level="default:info" 2026-11-01T20:52:56.313524Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T20:52:56.313529Z info FLAG: --log_target="[stdout]" 2026-11-01T20:52:56.313532Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T20:52:56.313533Z info FLAG: --outlierLogPath="" 2026-11-01T20:52:56.313536Z info FLAG: --profiling="true" 2026-11-01T20:52:56.313539Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T20:52:56.313541Z info FLAG: --proxyLogLevel="warning" 2026-11-01T20:52:56.313543Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T20:52:56.313545Z info FLAG: --stsPort="0" 2026-11-01T20:52:56.313547Z info FLAG: --templateFile="" 2026-11-01T20:52:56.313549Z info FLAG: --tokenManagerPlugin="" 2026-11-01T20:52:56.313552Z info FLAG: --vklog="0" 2026-11-01T20:52:56.313555Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T20:52:56.313735Z info Proxy role ips=[10.132.0.90] type=router id=maas-default-gateway-openshift-default-58c6585447-qnwxz.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T20:52:56.313782Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T20:52:56.314916Z info cpu limit detected as 2, setting concurrency 2026-11-01T20:52:56.315120Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T20:52:56.315131Z info JWT policy is third-party-jwt 2026-11-01T20:52:56.315134Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T20:52:56.316768Z info Starting default Istio SDS Server 2026-11-01T20:52:56.316793Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T20:52:56.316811Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T20:52:56.317760Z info Opening status port 15020 2026-11-01T20:52:56.318129Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T20:52:56.319406Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T20:52:56.320204Z info Starting proxy agent 2026-11-01T20:52:56.320237Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T20:52:56.329046Z info sds Starting SDS grpc server 2026-11-01T20:52:56.329070Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T20:52:56.390374Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T20:52:56.545956Z info cache generated new workload certificate resourceName=default latency=227.520045ms ttl=23h59m59.454048667s 2026-11-01T20:52:56.546007Z info cache Root cert has changed, start rotating root cert 2026-11-01T20:52:56.546044Z info cache returned workload trust anchor from cache ttl=23h59m59.453956143s 2026-11-01T20:52:56.614380Z info ads ADS: new connection for node:1 2026-11-01T20:52:56.614673Z info cache returned workload certificate from cache ttl=23h59m59.385330359s 2026-11-01T20:52:56.615333Z info ads ADS: new connection for node:2 2026-11-01T20:52:56.615624Z info cache returned workload trust anchor from cache ttl=23h59m59.384378615s 2026-11-01T20:52:56.705862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T20:53:03.521849Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-11-01T20:53:04.990211Z info Readiness succeeded in 8.679343344s 2026-11-01T20:53:04.990589Z info Envoy proxy is ready 2026-11-01T20:53:07.851610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T20:53:42.128086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T20:54:31.509416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T20:56:18.323424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T20:56:47.743887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T20:58:29.862380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:08:00.907599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:09:35.070494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:17:12.318911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:17:32.078881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:18:27.638620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:18:49.033941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:18:53.929275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:19:20.003238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:19:36.860076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:19:43.157116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:19:43.157157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:19:43.157172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:19:43.157177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T21:19:43.011Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 145 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "cc436676-e3d3-4f29-a4bd-c7fc61d514cd" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.90:56250 10.132.0.90:443 10.132.0.18:59264 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T21:19:45.865Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "7f2da851-2a96-4438-b1f8-e2264603db41" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:48254 10.132.0.90:443 10.132.0.18:59268 - v1-completions-path 2026-11-01T21:20:07.490478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:20:18.199691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:20:24.607754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:20:39.752159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-01T21:20:39.170Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "255aed80-9301-4b15-a9e6-87b0e1d5c3cd" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:48254 10.132.0.90:443 10.132.0.18:42256 - v1-completions-path [2026-11-01T21:20:39.698Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "04af5e82-8c99-4979-a8dc-88f8e4ed4178" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:48254 10.132.0.90:443 10.132.0.18:42268 - v1-completions-path [2026-11-01T21:20:41.247Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 83 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "676d7bbe-fe21-4fc4-8ca2-acd842baaf63" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:35244 10.132.0.90:443 10.132.0.18:42272 - v1-completions-path 2026-11-01T21:20:55.962783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:21:00.686779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:21:23.808864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:21:30.332251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T21:21:51.845Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 79 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "7fc512e3-7a0f-418a-9839-68389ba50ebe" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:51240 10.132.0.90:443 10.132.0.18:47372 - v1-completions-path 2026-11-01T21:21:56.355990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:22:18.235207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:22:20.022442Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T21:22:31.334784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:22:37.549698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:23:04.983841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:23:10.554226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:23:19.468510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:23:19.468545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:23:19.468563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:23:19.468568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T21:23:19.358Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 332 110 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "60072713-f3e2-4699-8a83-e5250640d786" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.90:54920 10.132.0.90:443 10.132.0.18:58378 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T21:23:20.288573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:23:20.288607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:23:20.288619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:23:20.288624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T21:23:19.951Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "de8bdb47-4238-4130-815a-d163768b15ae" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.90:443 10.132.0.18:58392 - v1-completions-path [2026-11-01T21:23:20.185Z] "DELETE /v1/api-keys/8c16eb9f-de90-42d4-8a91-ed9dcf17a889 HTTP/1.1" 404 - via_upstream - "-" 0 29 103 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "d3e4d404-76a4-4901-ba69-ffdd5ec25a46" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.90:54920 10.132.0.90:443 10.132.0.18:58402 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T21:23:21.922Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 33 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "492d38b1-a467-4717-af6a-793db8ad05b6" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.90:443 10.132.0.18:38204 - v1-completions-path 2026-11-01T21:23:30.396594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:23:52.936645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:24:03.580535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:24:51.176754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:24:57.175100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:27:22.145562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:27:28.268469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:28:45.925702Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T21:28:45.925725Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T21:28:45.925728Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T21:28:45.925733Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T21:28:45.878Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 47 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "782a6f92-f3da-4651-920f-7aa24a38c921" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.90:443 10.132.0.18:49150 - v1-completions-path 2026-11-01T21:29:09.029962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:29:26.207835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:29:30.963995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:29:54.925929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:31:53.574831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:31:53.574870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:31:53.574884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:31:53.574892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T21:31:53.522Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 52 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "99f25dc4-d0bd-4707-b399-de03c5669b0a" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.90:44728 10.132.0.90:443 10.132.0.18:32996 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T21:32:01.457724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:32:46.388695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:33:02.548590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:33:02.548626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:33:02.548643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T21:33:02.548648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T21:33:02.485Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 63 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "2e4e14ee-164e-49b1-9c5e-b9e41636ef63" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.90:42640 10.132.0.90:443 10.132.0.18:58526 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T21:33:04.756578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:33:20.089093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:33:35.017383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:33:47.343880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:33:52.193857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:34:21.116029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:40:37.320353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:40:43.892722Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-01T21:40:43.818Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "888443c1-d83a-4d83-b95c-0d2b51a20fc4" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:39590 10.132.0.90:443 10.132.0.18:54718 - v1-catch-all-path 2026-11-01T21:40:48.435794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:40:54.935592Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 2026-11-01T21:40:55.313240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-01T21:40:55.317860Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T21:40:54.870Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 65 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "b96d0cfb-dac0-4b72-8633-6a1d6cee8526" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:39590 10.132.0.90:443 10.132.0.18:54272 - v1-catch-all-path [2026-11-01T21:40:55.251Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 66 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "bc0bbca8-2848-493d-b34b-029420085521" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:52192 10.132.0.90:443 10.132.0.18:54274 - v1-catch-all-path [2026-11-01T21:40:55.623Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 60 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "482fc3f9-e56b-4eae-8536-697b737d8f07" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.90:443 10.132.0.18:54276 - v1-catch-all-path 2026-11-01T21:41:09.128710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:41:13.951425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:41:14.767006Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T21:41:14.624Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 142 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "5cbf7271-8c28-469b-89a5-fc681304947b" "maas.apps.323f621cca4560e48970.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.90:52192 10.132.0.90:443 10.132.0.18:41682 - v1-catch-all-path 2026-11-01T21:41:28.275396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T21:41:40.065235Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8