2026-11-03T08:02:06.884045Z info FLAG: --concurrency="0" 2026-11-03T08:02:06.884063Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T08:02:06.884067Z info FLAG: --help="false" 2026-11-03T08:02:06.884069Z info FLAG: --log_as_json="false" 2026-11-03T08:02:06.884071Z info FLAG: --log_caller="" 2026-11-03T08:02:06.884073Z info FLAG: --log_output_level="default:info" 2026-11-03T08:02:06.884075Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T08:02:06.884079Z info FLAG: --log_target="[stdout]" 2026-11-03T08:02:06.884081Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T08:02:06.884084Z info FLAG: --outlierLogPath="" 2026-11-03T08:02:06.884086Z info FLAG: --profiling="true" 2026-11-03T08:02:06.884088Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T08:02:06.884090Z info FLAG: --proxyLogLevel="warning" 2026-11-03T08:02:06.884092Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T08:02:06.884094Z info FLAG: --stsPort="0" 2026-11-03T08:02:06.884096Z info FLAG: --templateFile="" 2026-11-03T08:02:06.884098Z info FLAG: --tokenManagerPlugin="" 2026-11-03T08:02:06.884100Z info FLAG: --vklog="0" 2026-11-03T08:02:06.884103Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T08:02:06.884235Z info Proxy role ips=[10.132.0.58] type=router id=maas-default-gateway-openshift-default-76f4876667-87snj.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T08:02:06.884288Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T08:02:06.885807Z info cpu limit detected as 2, setting concurrency 2026-11-03T08:02:06.886033Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T08:02:06.886045Z info JWT policy is third-party-jwt 2026-11-03T08:02:06.886048Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T08:02:06.887798Z info Starting default Istio SDS Server 2026-11-03T08:02:06.887825Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T08:02:06.887843Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T08:02:06.888027Z info Opening status port 15020 2026-11-03T08:02:06.888874Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T08:02:06.889360Z info sds Starting SDS grpc server 2026-11-03T08:02:06.889374Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T08:02:06.890229Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T08:02:06.891026Z info Starting proxy agent 2026-11-03T08:02:06.891063Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T08:02:06.957751Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T08:02:07.018909Z info cache generated new workload certificate resourceName=default latency=129.401503ms ttl=23h59m59.98109497s 2026-11-03T08:02:07.018940Z info cache Root cert has changed, start rotating root cert 2026-11-03T08:02:07.018973Z info cache returned workload trust anchor from cache ttl=23h59m59.981027695s 2026-11-03T08:02:07.069600Z info ads ADS: new connection for node:1 2026-11-03T08:02:07.069661Z info cache returned workload certificate from cache ttl=23h59m59.930340367s 2026-11-03T08:02:07.069790Z info ads ADS: new connection for node:2 2026-11-03T08:02:07.069857Z info cache returned workload trust anchor from cache ttl=23h59m59.930143903s 2026-11-03T08:02:07.151411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:02:15.077924Z info Readiness succeeded in 8.196087875s 2026-11-03T08:02:15.078264Z info Envoy proxy is ready 2026-11-03T08:04:39.352565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:39.352603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:39.352619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T08:04:39.352624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T08:04:39.250Z] "DELETE /v1/api-keys/c3c173f4-88c0-4c52-a50e-8aac7227aba6 HTTP/1.1" 200 - via_upstream - "-" 0 321 101 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "3d35d4c3-1e2e-4a04-b32a-87d8f1d3eb4c" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:39518 10.132.0.58:443 10.132.0.13:58028 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:04:40.224503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.224542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.224556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.224561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T08:04:40.149Z] "DELETE /v1/api-keys/f2a01906-6535-44df-aec6-83af13bbefc3 HTTP/1.1" 200 - via_upstream - "-" 0 321 74 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "bc67193e-7ed9-4f0c-9e7f-bb73b9dd6010" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:41406 10.132.0.58:443 10.132.0.13:45518 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:04:49.628446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:49.628504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:49.628530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T08:04:49.628537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T08:04:49.071Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 557 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "1fe82aa6-3d08-4c75-b57f-5aa192d76e42" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:39518 10.132.0.58:443 10.132.0.13:45536 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T08:04:49.739Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 133 - "44.212.242.249,10.132.0.13" "-" "da0608d4-4fb3-4218-83d4-2e820d4ff43a" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:59074 10.132.0.58:443 10.132.0.13:56226 - v1-completions-path 2026-11-03T08:05:01.068830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:05:15.450520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:08:48.330267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:09:28.668820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:10:54.743193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:11:57.588992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:13:41.892411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:29:07.804875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:29:29.747776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:29:33.243282Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T08:30:13.816389Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T08:30:13.816415Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T08:30:13.816418Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T08:30:13.816422Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T08:30:13.781Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 35 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "c65babc6-9879-4cc0-bd59-1c37df3496dd" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.58:443 10.132.0.13:46084 - v1-completions-path 2026-11-03T08:30:15.996995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T08:30:22.706Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "7d560d6c-8532-4b69-b5f7-d8c359ad8052" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.58:443 10.132.0.13:51200 - v1-completions-path 2026-11-03T08:30:34.215417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:30:35.949871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:30:41.362846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:30:41.362881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:30:41.362895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:30:41.362900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T08:30:41.294Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 67 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "508b1592-d277-437c-916d-86dfe38c765c" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:49584 10.132.0.58:443 10.132.0.13:50144 - v1-catch-all-path 2026-11-03T08:30:52.855509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:30:54.478697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:30:57.211975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:05.551538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:11.378116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:31:11.378160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:31:11.378180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:31:11.378201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T08:31:11.314Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 320 63 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "e306022e-83b8-455d-b0fb-4fd00621e0ea" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:46028 10.132.0.58:443 10.132.0.13:40412 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:31:29.917929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:40.081896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:41.911589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:47.113204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:31:47.113238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:31:47.113253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:31:47.113259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T08:31:47.047Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 66 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "315b12cd-539a-4c48-9694-2aa013a5a4b7" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:46028 10.132.0.58:443 10.132.0.13:56494 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T08:31:47.187Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 60 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "51f10766-f1dc-4daf-b26f-67df517ed6d7" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:58138 10.132.0.58:443 10.132.0.13:56500 - v1-completions-path [2026-11-03T08:31:48.474Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 56 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "efa4509d-a2b8-452c-8b47-151e94219898" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:49584 10.132.0.58:443 10.132.0.13:56504 - v1-completions-path 2026-11-03T08:32:00.490629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:02.356034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:18.541458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:20.648547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:37.121100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:38.704973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:54.746239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:05.381264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:08.004030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:26.929277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:29.058384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:33.072057Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T08:33:36.136477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:38.817512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:57.888513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:34:08.155246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:34:23.829809Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:34:26.872795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:36:07.036744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:36:10.130884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:37:36.894017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:37:51.705090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:37:53.252028Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:38:12.451362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:39:38.027225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:39:54.155888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:09.496630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:21.185210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:21.772741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:40:21.772810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:40:21.772824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:40:21.772830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:40:21.836379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T08:40:21.898638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:40:21.898669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:40:21.898682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:40:21.898687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T08:40:21.679Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 93 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "32bac83b-02b7-42c7-a213-589c78ac8768" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:47366 10.132.0.58:443 10.132.0.13:39470 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T08:40:21.829Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 69 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "fa74172b-3b6f-4e6e-af1b-450abb102837" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:47366 10.132.0.58:443 10.132.0.13:39480 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:40:25.128977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:33.476194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:36.129725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T08:40:41.726Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "e43153aa-7579-4eaf-8b56-f62e01fa9bcb" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:58138 10.132.0.58:443 10.132.0.13:38818 - v1-completions-path 2026-11-03T08:40:53.762495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:43:40.907288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:43:44.173608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T08:43:44.174330Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T08:43:44.101Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 72 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "b13258a7-f3fc-45d2-b972-3bf80e421728" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:49604 10.132.0.58:443 10.132.0.13:33232 - v1-catch-all-path 2026-11-03T08:43:46.067620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:44:01.715352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:44:03.272004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:44:17.432777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:44:28.168369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8