2026-11-01T06:11:51.093295Z info FLAG: --concurrency="0" 2026-11-01T06:11:51.093312Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T06:11:51.093316Z info FLAG: --help="false" 2026-11-01T06:11:51.093318Z info FLAG: --log_as_json="false" 2026-11-01T06:11:51.093320Z info FLAG: --log_caller="" 2026-11-01T06:11:51.093322Z info FLAG: --log_output_level="default:info" 2026-11-01T06:11:51.093324Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T06:11:51.093329Z info FLAG: --log_target="[stdout]" 2026-11-01T06:11:51.093331Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T06:11:51.093333Z info FLAG: --outlierLogPath="" 2026-11-01T06:11:51.093335Z info FLAG: --profiling="true" 2026-11-01T06:11:51.093337Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T06:11:51.093339Z info FLAG: --proxyLogLevel="warning" 2026-11-01T06:11:51.093341Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T06:11:51.093343Z info FLAG: --stsPort="0" 2026-11-01T06:11:51.093344Z info FLAG: --templateFile="" 2026-11-01T06:11:51.093346Z info FLAG: --tokenManagerPlugin="" 2026-11-01T06:11:51.093349Z info FLAG: --vklog="0" 2026-11-01T06:11:51.093351Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T06:11:51.093495Z info Proxy role ips=[10.133.1.59] type=router id=maas-default-gateway-openshift-default-58d898bd55-8ng9q.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T06:11:51.093547Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T06:11:51.094819Z info cpu limit detected as 2, setting concurrency 2026-11-01T06:11:51.095087Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T06:11:51.095100Z info JWT policy is third-party-jwt 2026-11-01T06:11:51.095103Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T06:11:51.096946Z info Starting default Istio SDS Server 2026-11-01T06:11:51.096966Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T06:11:51.096982Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T06:11:51.097473Z info Opening status port 15020 2026-11-01T06:11:51.098085Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T06:11:51.099277Z info sds Starting SDS grpc server 2026-11-01T06:11:51.099294Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T06:11:51.099506Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T06:11:51.100291Z info Starting proxy agent 2026-11-01T06:11:51.100322Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T06:11:51.169759Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T06:11:51.252124Z info cache generated new workload certificate resourceName=default latency=152.746858ms ttl=23h59m59.747882598s 2026-11-01T06:11:51.252174Z info cache Root cert has changed, start rotating root cert 2026-11-01T06:11:51.252211Z info cache returned workload trust anchor from cache ttl=23h59m59.747789786s 2026-11-01T06:11:51.340884Z info ads ADS: new connection for node:1 2026-11-01T06:11:51.340960Z info cache returned workload certificate from cache ttl=23h59m59.659043579s 2026-11-01T06:11:51.341233Z info ads ADS: new connection for node:2 2026-11-01T06:11:51.341332Z info cache returned workload trust anchor from cache ttl=23h59m59.658669342s 2026-11-01T06:11:51.424426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:11:59.477361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:00.570531Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T06:12:01.771177Z info Readiness succeeded in 10.681060006s 2026-11-01T06:12:01.771675Z info Envoy proxy is ready 2026-11-01T06:12:01.771831Z info Readiness succeeded in 10.681726015s 2026-11-01T06:12:02.750686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:12.521271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:16.037381Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T06:12:15.950Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 86 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "7193fa14-7a02-44bb-8bf0-195e1a798740" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:37502 10.133.1.59:443 10.132.0.14:36132 - v1-catch-all-path 2026-11-01T06:12:26.103900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:35.281213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:51.886188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:03.458302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:06.585220Z info ads ADS: new connection for node:3 2026-11-01T06:13:06.585651Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:06.585732Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:10.248541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:49.409739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:13:54.947Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 328 87 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "f4e4f0e5-2c4c-4299-a35b-a6044bc41bf3" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.1.64:8000" outbound|54321||e2e-prio-pool-25304531-inference-pool-ip-eb3771a1.llm.svc.cluster.local 10.133.1.59:37380 10.133.1.59:443 10.132.0.14:47720 - v1-model-routing [2026-11-01T06:13:59.034Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 336 57 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "efd364b3-89b3-4013-85c3-4ae62d7c2b72" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.1.64:8000" outbound|54321||e2e-prio-pool-25304531-inference-pool-ip-eb3771a1.llm.svc.cluster.local 10.133.1.59:37380 10.133.1.59:443 10.132.0.14:38954 - v1-model-routing 2026-11-01T06:14:13.276045Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T06:14:13.327826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:18.152230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:32.858646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:44.711088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:11.447506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:36.557967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:51.811760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:00.293281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:15.684987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:20.483346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:38.684898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:27.606233Z info ads ADS: new connection for node:4 2026-11-01T06:17:27.612696Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T06:17:27.612759Z info cache read certificate from file resource=file-root:system 2026-11-01T06:17:31.200621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:32.596389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:18:19.549712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-01T06:18:19.615510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:19.615543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:19.615552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:18:19.615557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:19.615750Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T06:18:19.489Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 126 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "9de63e4b-8fee-4022-8898-554281071949" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.59:37902 10.133.1.59:443 10.132.0.14:55918 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:19:23.736843Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T06:19:23.777447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:26.328957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:36.575909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:19:40.495Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 75 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "7ca0430c-cc0e-4fba-a9c4-1a8bfb1a4f87" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:41460 10.133.1.59:443 10.132.0.14:36008 - v1-completions-path 2026-11-01T06:19:54.872158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:11.755864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:20:21.847Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "73d353b9-0e11-4ad6-96a3-a5c228d87cbb" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:45396 10.133.1.59:443 10.132.0.14:58956 - v1-completions-path [2026-11-01T06:20:24.164Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "7da0539c-f8ea-40d4-b93d-e395b17a04ab" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:41460 10.133.1.59:443 10.132.0.14:58960 - v1-completions-path [2026-11-01T06:20:24.673Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "6de30138-028f-41b2-a450-a5d50ce8548e" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:45396 10.133.1.59:443 10.132.0.14:58976 - v1-completions-path 2026-11-01T06:20:42.466155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:53.024273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:59.432984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:13.535808Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-01T06:21:13.475Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "dd74a251-0151-4303-aaf6-dcd176b768fe" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:45396 10.133.1.59:443 10.132.0.14:37926 - v1-completions-path 2026-11-01T06:21:28.072328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:32.650917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:45.932503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:55.905406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:19.592936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:30.189263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:48.184904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:54.319868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:12.482015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:17.892756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:23:17.065Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 59 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "94c605f8-31c8-4da0-953b-394997de16b8" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.59:443 10.132.0.14:39388 - v1-completions-path [2026-11-01T06:23:19.321Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 77 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e35c5d1d-566f-451a-833e-5ba439fa91a0" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:46094 10.133.1.59:443 10.132.0.14:42510 - v1-completions-path [2026-11-01T06:23:19.595Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 34 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d5acf3b4-2888-4ec5-90fe-b8b0ba21f1f5" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.59:443 10.132.0.14:42514 - v1-completions-path 2026-11-01T06:23:29.201262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:55.979536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:06.655461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:39.520314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:24:39.520351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:24:39.520370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:24:39.520375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T06:24:39.401Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 118 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "06c51f46-7789-487f-bf85-dfbec858f8da" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.59:44852 10.133.1.59:443 10.132.0.14:39554 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:24:54.872402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:25:02.472502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:01.102387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:27:01.102443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:27:01.102469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:27:01.102475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T06:27:00.929Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 172 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "ad30d12e-9c78-49bc-9267-a5b4bd4a5f20" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.59:44278 10.133.1.59:443 10.132.0.14:47838 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:27:16.542303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:45.011393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:28:49.949Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 290 79 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "3e54cbe5-f311-4ff9-84f3-c212f8333cf7" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:45262 10.133.1.59:443 10.132.0.14:50210 - v1-completions-path 2026-11-01T06:29:04.539921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:09.503426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:21.333786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:38.125963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:43.040093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:45.679247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:29:45.679311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:29:45.679327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:29:45.679332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T06:29:45.547Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 131 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "a048dfbf-a804-4653-bdec-7e9bca9f3730" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.159:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.59:54856 10.133.1.59:443 10.132.0.14:48840 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:29:48.442Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "abd3597a-9af3-4a03-ac26-5e30a81062c8" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:45396 10.133.1.59:443 10.132.0.14:57234 - v1-completions-path 2026-11-01T06:30:02.726856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:13.371599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:19.909361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:35.014871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:30:35.014910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:30:35.014926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:30:35.014931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:30:34.897Z] "DELETE /v1/api-keys/658adf15-b40d-45fc-81ec-07352c894255 HTTP/1.1" 200 - via_upstream - "-" 0 365 117 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "53b72b25-e420-4145-9aa6-b99ec6942af2" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.159:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.59:54856 10.133.1.59:443 10.132.0.14:59770 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:30:48.827029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:55.288622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:01.202103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:31:11.374Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "79cf4d92-2cbc-48b7-aae4-b92b3ede8f47" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:41460 10.133.1.59:443 10.132.0.14:49664 - v1-completions-path [2026-11-01T06:31:13.080Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 59 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "a0f75564-ecde-4567-9dea-54b4855808d7" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:41460 10.133.1.59:443 10.132.0.14:49680 - v1-completions-path [2026-11-01T06:31:14.864Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e8fbb32a-e8a7-402a-9f66-183e0336d0ff" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:45396 10.133.1.59:443 10.132.0.14:49692 - v1-completions-path [2026-11-01T06:31:16.302Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "633c4f93-ced5-4460-b29a-af7628b4cf20" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.59:45396 10.133.1.59:443 10.132.0.14:49702 - v1-completions-path 2026-11-01T06:31:33.387887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:44.077770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:50.708930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:56.537874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:08.563971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:32.216180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:42.873058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:47.607866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:05.840066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:11.923366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:35.588620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:57.651736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:17.527019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:28.428015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:39.344618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:50.281421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:00.998758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:11.802688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:22.559649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:33.173057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:41.418078Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T06:35:41.418110Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T06:35:41.418115Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T06:35:41.418122Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-01T06:35:41.392Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 25 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "455f49f6-2ec7-4f93-8a71-8d718861b7b5" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.59:443 10.132.0.14:49286 - v1-completions-path