2026-11-04T01:15:33.266768Z info FLAG: --concurrency="0" 2026-11-04T01:15:33.266794Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:15:33.266800Z info FLAG: --help="false" 2026-11-04T01:15:33.266804Z info FLAG: --log_as_json="false" 2026-11-04T01:15:33.266807Z info FLAG: --log_caller="" 2026-11-04T01:15:33.266811Z info FLAG: --log_output_level="default:info" 2026-11-04T01:15:33.266816Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:15:33.266824Z info FLAG: --log_target="[stdout]" 2026-11-04T01:15:33.266830Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:15:33.266833Z info FLAG: --outlierLogPath="" 2026-11-04T01:15:33.266836Z info FLAG: --profiling="true" 2026-11-04T01:15:33.266841Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:15:33.266844Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:15:33.266848Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:15:33.266851Z info FLAG: --stsPort="0" 2026-11-04T01:15:33.266856Z info FLAG: --templateFile="" 2026-11-04T01:15:33.266860Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:15:33.266864Z info FLAG: --vklog="0" 2026-11-04T01:15:33.266868Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:15:33.267103Z info Proxy role ips=[10.132.0.35] type=router id=maas-default-gateway-openshift-default-75d7c785f-xfhf7.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:15:33.267231Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:15:33.269023Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:15:33.269405Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:15:33.269421Z info JWT policy is third-party-jwt 2026-11-04T01:15:33.269425Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:15:33.270711Z info Starting default Istio SDS Server 2026-11-04T01:15:33.270736Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:15:33.270758Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:15:33.270926Z info Opening status port 15020 2026-11-04T01:15:33.272727Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:15:33.273508Z info sds Starting SDS grpc server 2026-11-04T01:15:33.273569Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:15:33.275241Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:15:33.278463Z info Starting proxy agent 2026-11-04T01:15:33.278495Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:15:33.359712Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:15:33.380523Z info cache generated new workload certificate resourceName=default latency=106.843826ms ttl=23h59m59.619479875s 2026-11-04T01:15:33.380555Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:15:33.380587Z info cache returned workload trust anchor from cache ttl=23h59m59.619413141s 2026-11-04T01:15:33.446061Z info ads ADS: new connection for node:1 2026-11-04T01:15:33.446743Z info cache returned workload certificate from cache ttl=23h59m59.553259773s 2026-11-04T01:15:33.447307Z info ads ADS: new connection for node:2 2026-11-04T01:15:33.447378Z info cache returned workload trust anchor from cache ttl=23h59m59.552623874s 2026-11-04T01:15:33.491472Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:15:40.011483Z info Readiness succeeded in 6.752119525s 2026-11-04T01:15:40.011797Z info Envoy proxy is ready 2026-11-04T01:16:32.587862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:16:34.288169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:16:35.903924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:16:37.974014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:16:40.325182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:16:43.430285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:16:46.431268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:17:03.828091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:17:04.321952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:17:39.943Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 355 87 - "44.212.242.249,10.132.0.15" "curl/7.76.1" "26a117d5-b24e-4314-9087-04258f3e6939" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:49970 10.132.0.35:443 10.132.0.15:43540 - v1-model-routing [2026-11-04T01:17:41.008Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "44.212.242.249,10.132.0.15" "curl/7.76.1" "5081e6cc-e3bd-4daa-ab11-5863f9410897" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.15:43544 - v1-model-routing 2026-11-04T01:19:59.035596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:19:59.035635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:19:59.035652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:19:59.035658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:19:58.968Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 66 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2160e38d-c05e-44f5-bc05-cf006d3211ea" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.134.0.21:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:52066 10.132.0.35:443 10.132.0.15:34334 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:19:59.890769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:19:59.890800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:19:59.890812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:19:59.890816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:19:59.829Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 61 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c94be4fb-77ab-4f98-8216-9112a6257308" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.134.0.21:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:52066 10.132.0.35:443 10.132.0.15:34348 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:20:04.951741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:20:04.951851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-04T01:20:04.951905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:20:04.951953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:20:04.951982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:20:04.887Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 64 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "4cd479eb-feb8-47e2-921e-0453b41d5ff5" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.134.0.21:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:52066 10.132.0.35:443 10.132.0.15:34368 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:20:08.124Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 72 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "1432a5a5-ab74-43e9-9421-f920f710b824" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:49970 10.132.0.35:443 10.132.0.15:34384 - v1-completions-path 2026-11-04T01:20:16.817735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:20:30.129910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:24:01.339Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 1809 104 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "89b9e518-eed6-4bb7-b5f7-40b2486827dd" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:49970 10.132.0.35:443 10.132.0.15:50610 - v1-chat-completions-path 2026-11-04T01:25:16.596273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:25:30.690553Z warn xdsproxy sendDownstreamDelta took 14.378358436s 2026-11-04T01:26:06.343685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:27:25.237311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:29:23.816217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:31:27.336852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:32:03.478008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:33:26.885968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:35:02.653784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:36:02.127320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:36:02.127354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:36:02.127368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:36:02.127372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T01:36:02.048Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 78 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "d19f66d6-c08d-4f1b-b216-34487503e005" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.134.0.21:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:60778 10.132.0.35:443 10.132.0.15:60956 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:36:04.736856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:36:27.177601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:37:14.368104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:37:30.444839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:37:32.114876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:37:37.773231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:37:48.419049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:37:52.148909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:38:00.423239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:38:04.571Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 76 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "cf373f44-32bd-4f26-8cf4-b3d401120fd0" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.133.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:41088 10.132.0.35:443 10.132.0.15:47596 - v1-completions-path [2026-11-04T01:38:07.122Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "d8eb3829-4d3c-477d-87d3-a7209331a8a8" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.133.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:41088 10.132.0.35:443 10.132.0.15:47604 - v1-completions-path 2026-11-04T01:38:22.968614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:38:33.095752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:38:35.311009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:38:54.013091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:38:55.876481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:38:59.524952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:38:59.524985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:38:59.524996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:38:59.525001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:38:59.454Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 70 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "184a6b80-6e69-4cc9-bf4f-5d9c3da5ea36" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.134.0.21:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:43678 10.132.0.35:443 10.132.0.15:52084 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:39:01.788883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:39:13.261342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:39:26.897710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:39:28.525604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:39:34.488018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:39:52.059899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:39:55.547559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:39:58.884Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 119 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "585c64f3-a82d-4669-81a6-5bbb1b9ffd5f" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:49970 10.132.0.35:443 10.132.0.15:51144 - v1-completions-path 2026-11-04T01:40:10.502189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:40:12.139022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:40:13.456Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 80 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c85921b0-95e4-431d-bd34-88ac43a39b1d" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:54896 10.132.0.35:443 10.132.0.15:34536 - v1-completions-path 2026-11-04T01:40:17.931775Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:40:33.518632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:40:43.803145Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:40:59.429293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:41:02.197090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:43:17.010338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:43:20.144670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:44:21.386409Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:44:21.386431Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:44:21.386434Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:44:21.386439Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-04T01:44:21.342Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 44 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "8c09312c-2c8a-4570-92a6-f69d43cda298" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.15:47360 - v1-completions-path 2026-11-04T01:44:40.072876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:44:55.599089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:44:57.411343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:45:03.758297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:45:33.253383Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-04T01:47:22.273290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:47:36.003460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:47:51.778489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:48:03.537019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:48:07.536693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:48:15.424815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:48:17.998856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:48:22.230788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:48:22.230827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:48:22.230842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:48:22.230848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:48:22.176Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 54 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "59823a0d-b30f-4f96-ac90-dcc6517f379f" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.134.0.21:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:38744 10.132.0.35:443 10.132.0.15:52500 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:48:33.758469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:51:08.016382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:51:11.544418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:51:11.544452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:51:11.544463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:51:11.544469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:51:11.684747Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-04T01:51:11.473Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 71 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "560c42c8-27ae-4175-b6a2-7ed5f9c7e563" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.133.0.167:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:60004 10.132.0.35:443 10.132.0.15:38792 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:51:11.601Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 83 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "1c2bdd04-205e-49b9-bec2-79a77ffda8e3" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:44038 10.132.0.35:443 10.132.0.15:38814 - v1-catch-all-path 2026-11-04T01:51:14.054876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:51:18.316922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-04T01:51:18.309Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 61 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2c78ddc2-60fc-414e-b241-431b02e5afa6" "maas.apps.db7c6f5a60cadf03a449.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.15:38826 - v1-catch-all-path 2026-11-04T01:51:29.878576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:51:31.515971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:51:46.477819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:51:57.242427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9