2026-10-30T04:55:56.625265Z info FLAG: --concurrency="0" 2026-10-30T04:55:56.625283Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T04:55:56.625287Z info FLAG: --help="false" 2026-10-30T04:55:56.625290Z info FLAG: --log_as_json="false" 2026-10-30T04:55:56.625292Z info FLAG: --log_caller="" 2026-10-30T04:55:56.625294Z info FLAG: --log_output_level="default:info" 2026-10-30T04:55:56.625296Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T04:55:56.625300Z info FLAG: --log_target="[stdout]" 2026-10-30T04:55:56.625303Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T04:55:56.625305Z info FLAG: --outlierLogPath="" 2026-10-30T04:55:56.625307Z info FLAG: --profiling="true" 2026-10-30T04:55:56.625309Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T04:55:56.625311Z info FLAG: --proxyLogLevel="warning" 2026-10-30T04:55:56.625314Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T04:55:56.625316Z info FLAG: --stsPort="0" 2026-10-30T04:55:56.625318Z info FLAG: --templateFile="" 2026-10-30T04:55:56.625320Z info FLAG: --tokenManagerPlugin="" 2026-10-30T04:55:56.625322Z info FLAG: --vklog="0" 2026-10-30T04:55:56.625325Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T04:55:56.625578Z info Proxy role ips=[10.134.0.41] type=router id=maas-default-gateway-openshift-default-6f77ddbcb7-52stt.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T04:55:56.625625Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T04:55:56.626631Z info cpu limit detected as 2, setting concurrency 2026-10-30T04:55:56.626824Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T04:55:56.626835Z info JWT policy is third-party-jwt 2026-10-30T04:55:56.626838Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T04:55:56.628573Z info Starting default Istio SDS Server 2026-10-30T04:55:56.628592Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T04:55:56.628610Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T04:55:56.629200Z info Opening status port 15020 2026-10-30T04:55:56.629714Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T04:55:56.630971Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T04:55:56.631804Z info Starting proxy agent 2026-10-30T04:55:56.631844Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T04:55:56.641444Z info sds Starting SDS grpc server 2026-10-30T04:55:56.641558Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T04:55:56.696420Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T04:55:56.699599Z info cache generated new workload certificate resourceName=default latency=68.480349ms ttl=23h59m59.300404684s 2026-10-30T04:55:56.699628Z info cache Root cert has changed, start rotating root cert 2026-10-30T04:55:56.699658Z info cache returned workload trust anchor from cache ttl=23h59m59.30034214s 2026-10-30T04:55:56.805392Z info ads ADS: new connection for node:1 2026-10-30T04:55:56.805655Z info cache returned workload certificate from cache ttl=23h59m59.194347424s 2026-10-30T04:55:56.806404Z info ads ADS: new connection for node:2 2026-10-30T04:55:56.806557Z info cache returned workload trust anchor from cache ttl=23h59m59.193444496s 2026-10-30T04:55:56.888748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:56:04.847034Z info Readiness succeeded in 8.224930172s 2026-10-30T04:56:04.847565Z info Envoy proxy is ready 2026-10-30T04:58:32.794840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:32.794879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:32.794893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:32.794898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:58:32.697Z] "DELETE /v1/api-keys/6b1b4df0-4bf2-41b5-a815-0154bda658cc HTTP/1.1" 200 - via_upstream - "-" 0 370 97 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "317a2313-eda5-40b7-8f15-842efdb07a99" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:43366 10.134.0.41:443 10.132.0.15:49322 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:58:33.239892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:33.240004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:33.240061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:33.240095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:58:33.144Z] "DELETE /v1/api-keys/e6bd69bd-f08d-42a4-81b6-777bfed18f4c HTTP/1.1" 200 - via_upstream - "-" 0 321 95 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "0d671777-af75-9e87-bd91-412969ecf183" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:43366 10.134.0.41:443 10.132.0.15:49338 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:58:35.983Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 49 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "20491952-88ee-4774-ae97-57a2b8817868" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.41:443 10.132.0.15:57158 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:58:36.226251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:36.226398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:36.226476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:58:36.226513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:58:36.568452Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:58:36.568471Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:58:36.568474Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:58:36.568478Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 2026-10-30T04:58:36.857787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:58:36.857831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:58:36.857851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:58:36.857857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:58:36.145Z] "DELETE /v1/api-keys/dca14134-a6ea-4525-97a8-0ad9d3dbcdf9 HTTP/1.1" 200 - via_upstream - "-" 0 321 80 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "3ff9ff84-955f-4c40-b827-3b7f909d1b4a" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:43366 10.134.0.41:443 10.132.0.15:57168 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:58:36.535Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 33 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "5e94762f-f598-499a-ab50-954ee9950301" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.41:443 10.132.0.15:57172 - v1-completions-path [2026-10-30T04:58:36.762Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 95 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "5bdcb9a5-312d-4609-a0f2-8d5c25cf7864" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:36938 10.134.0.41:443 10.132.0.15:57186 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:58:42.007732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:58:42.007851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:58:42.007907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:58:42.007935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:58:41.870Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 137 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "f45dc3bd-87ff-4c81-b86b-e30b393cbe33" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:36938 10.134.0.41:443 10.132.0.15:57198 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:58:44.883Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 134 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "cce7d12b-8160-4863-8f1c-7209408f4bf2" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:38324 10.134.0.41:443 10.132.0.15:38408 - v1-completions-path 2026-10-30T04:58:49.978302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:58:49.978337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:58:49.978350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:58:49.978370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T04:58:49.908Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 69 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "4ab464bf-f33d-4044-9d32-536d74ce2839" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:36938 10.134.0.41:443 10.132.0.15:38426 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:58:58.575984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:59:14.435597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:02:48.457793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:02:48.457944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:02:48.457997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:02:48.458027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T05:02:48.381Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 76 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "b168e2bc-6971-41c6-880e-918b2e458d8a" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:37782 10.134.0.41:443 10.132.0.15:59212 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T05:03:39.488883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:04:07.396952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:05:38.231309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:08:37.964293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:09:16.970988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:10:54.984093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:24:46.623514Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T05:37:36.743905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:37:36.743971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:37:36.743989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:37:36.743995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T05:37:36.744237Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-30T05:37:36.744301Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:37:36.744309Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:37:36.744313Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:37:36.744317Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T05:37:36.670Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 73 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "3c588050-2259-4a3c-b281-661768d79cfa" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:38324 10.134.0.41:443 10.132.0.15:34888 - v1-chat-completions-path 2026-10-30T05:40:46.353338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:40:46.353400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:40:46.353415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:40:46.353420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T05:40:46.270Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 83 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "82d00d48-a289-490f-922c-5d9102434183" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:37074 10.134.0.41:443 10.132.0.15:60562 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:40:49.091380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:41:15.942352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:41:51.457067Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:41:51.457091Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:41:51.457094Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:41:51.457098Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T05:41:51.422Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 34 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "41293b20-cee1-41a8-be2e-d68fe7270d11" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.41:443 10.132.0.15:36044 - v1-completions-path 2026-10-30T05:41:54.961060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:42:14.008704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:42:18.159915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:42:22.609018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:42:22.609056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:42:22.609071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T05:42:22.609076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T05:42:22.510Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 98 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "22c50daf-71c4-4e0b-ac1d-bdc2db53627e" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:56810 10.134.0.41:443 10.132.0.15:54456 - v1-catch-all-path [2026-10-30T05:42:33.716Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 79 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "53db1748-ff10-4f8a-adf2-2ebc8b483e52" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:49664 10.134.0.41:443 10.132.0.15:51134 - v1-completions-path 2026-10-30T05:42:34.426650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:42:42.623651Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T05:42:50.148332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T05:42:56.042Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "831bde7f-cf7f-4e08-b79b-755c7bc074b6" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:38904 10.134.0.41:443 10.132.0.15:33688 - v1-completions-path 2026-10-30T05:42:57.498147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T05:42:57.494Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 73 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "810451ad-3dd9-4fc4-b147-a9c7f89ce63e" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:38904 10.134.0.41:443 10.132.0.15:33692 - v1-completions-path [2026-10-30T05:42:58.223Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 54 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "b7104d10-659f-43cf-908e-7e514bb7f9e8" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:56810 10.134.0.41:443 10.132.0.15:33722 - v1-completions-path 2026-10-30T05:43:14.288117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:43:24.692598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:43:29.130685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:43:46.810543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:43:48.965889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:05.529467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:10.279956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:27.612336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:43.562259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T05:44:43.495Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 71 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "7713fbe2-de9a-49b5-a294-ba8a4a0f2842" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:49664 10.134.0.41:443 10.132.0.15:37712 - v1-completions-path 2026-10-30T05:44:44.718019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:55.376306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:58.235016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T05:45:03.789Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 64 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "43cfa9ca-59c8-426f-9512-97afe2e82638" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:38324 10.134.0.41:443 10.132.0.15:45272 - v1-completions-path 2026-10-30T05:45:16.395339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:45:19.021514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:48:21.766315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:48:21.766377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T05:48:21.766395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T05:48:21.766400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T05:48:21.682Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 83 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "e22dcf69-6fed-427b-895c-ac13d8b51390" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:41090 10.134.0.41:443 10.132.0.15:60714 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:48:42.701751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:48:57.908309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:48:59.917135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:49:14.441903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:50:27.203879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:50:27.203913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:50:27.203926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T05:50:27.203931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T05:50:27.137Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 66 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "4274efa8-de27-4b14-8939-44cc6286250c" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.41:33726 10.134.0.41:443 10.132.0.15:54702 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:50:31.483014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:50:49.428332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:04.337858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:18.439576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:22.223815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:33.685686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:37.223966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:57.089961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:06.953437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:15.303455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:20.958763Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T05:52:20.885Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 73 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "cfdcf861-0f4c-477d-9c3a-cd07838930a4" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.41:38382 10.134.0.41:443 10.132.0.15:43994 - v1-catch-all-path 2026-10-30T05:52:33.129104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:35.352820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:49.897864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:53:00.860083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8