2026-11-02T01:23:54.144852Z info FLAG: --concurrency="0" 2026-11-02T01:23:54.144874Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T01:23:54.144879Z info FLAG: --help="false" 2026-11-02T01:23:54.144882Z info FLAG: --log_as_json="false" 2026-11-02T01:23:54.144884Z info FLAG: --log_caller="" 2026-11-02T01:23:54.144887Z info FLAG: --log_output_level="default:info" 2026-11-02T01:23:54.144890Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T01:23:54.144896Z info FLAG: --log_target="[stdout]" 2026-11-02T01:23:54.144899Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T01:23:54.144902Z info FLAG: --outlierLogPath="" 2026-11-02T01:23:54.144905Z info FLAG: --profiling="true" 2026-11-02T01:23:54.144909Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T01:23:54.144912Z info FLAG: --proxyLogLevel="warning" 2026-11-02T01:23:54.144915Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T01:23:54.144919Z info FLAG: --stsPort="0" 2026-11-02T01:23:54.144922Z info FLAG: --templateFile="" 2026-11-02T01:23:54.144925Z info FLAG: --tokenManagerPlugin="" 2026-11-02T01:23:54.144929Z info FLAG: --vklog="0" 2026-11-02T01:23:54.144932Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T01:23:54.145155Z info Proxy role ips=[10.134.0.58] type=router id=maas-default-gateway-openshift-default-76597d6855-q856k.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T01:23:54.145222Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T01:23:54.146427Z info cpu limit detected as 2, setting concurrency 2026-11-02T01:23:54.146679Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T01:23:54.146694Z info JWT policy is third-party-jwt 2026-11-02T01:23:54.146698Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T01:23:54.148743Z info Starting default Istio SDS Server 2026-11-02T01:23:54.148767Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T01:23:54.148799Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T01:23:54.149011Z info Opening status port 15020 2026-11-02T01:23:54.150095Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T01:23:54.151435Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T01:23:54.152399Z info Starting proxy agent 2026-11-02T01:23:54.152436Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T01:23:54.160906Z info sds Starting SDS grpc server 2026-11-02T01:23:54.160931Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T01:23:54.218594Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T01:23:54.324679Z info ads ADS: new connection for node:1 2026-11-02T01:23:54.325269Z info ads ADS: new connection for node:2 2026-11-02T01:23:54.469603Z info cache generated new workload certificate resourceName=default latency=319.830926ms ttl=23h59m59.530401669s 2026-11-02T01:23:54.469646Z info cache Root cert has changed, start rotating root cert 2026-11-02T01:23:54.469688Z info cache returned workload trust anchor from cache ttl=23h59m59.530312816s 2026-11-02T01:23:54.469717Z info cache returned workload certificate from cache ttl=23h59m59.53029083s 2026-11-02T01:23:54.469818Z info cache returned workload trust anchor from cache ttl=23h59m59.530189724s 2026-11-02T01:23:54.470079Z info cache returned workload trust anchor from cache ttl=23h59m59.529922594s 2026-11-02T01:23:54.551030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:24:02.914367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:24:04.889797Z info Readiness succeeded in 10.748057926s 2026-11-02T01:24:04.890238Z info Envoy proxy is ready 2026-11-02T01:24:04.931090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:24:04.949388Z info Readiness succeeded in 10.807649382s 2026-11-02T01:24:36.108155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:24:36.108195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:24:36.108211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:24:36.108216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T01:24:36.000Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 107 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "7555a1e6-5fa2-4473-8928-e5b543cd0f3b" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:47776 10.134.0.58:443 10.132.0.21:36110 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T01:24:36.209Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 389 66 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "03c7b22c-9c47-4f49-8f9e-4ec88d9d23b0" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:59114 10.134.0.58:443 10.132.0.21:36124 - v1-model-routing [2026-11-02T01:26:55.587Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 55 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "24fb4aa8-7f33-4208-806b-e00152eb9f90" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.58:443 10.132.0.21:60402 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T01:26:56.596746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:26:56.596786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:26:56.596799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:26:56.596804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T01:26:56.200Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 37 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "8fdee8d7-32f1-470e-931a-7675fc3e26c8" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.58:443 10.132.0.21:60410 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T01:26:56.492Z] "DELETE /v1/api-keys/569770a2-6655-4e24-9e9d-9ffc89007709 HTTP/1.1" 200 - via_upstream - "-" 0 321 104 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "29fde35c-b5cc-41dd-86bb-791a92acbedb" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:59304 10.134.0.58:443 10.132.0.21:60422 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T01:26:58.224920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:26:58.224955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:26:58.224968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:26:58.224973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T01:26:58.143Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 81 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "b42d4e6f-f332-4770-890a-14d9203502af" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:59320 10.134.0.58:443 10.132.0.21:60432 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T01:27:02.983931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:27:02.983973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:27:02.983991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:27:02.983998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T01:27:03.096728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T01:27:02.912Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 71 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "762a42df-dba0-43bb-8dea-0cd4effb275a" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:59320 10.134.0.58:443 10.132.0.21:44348 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T01:27:03.039Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 62 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "5f49f0cf-3f9f-4b3b-9d4c-95e57654eb4f" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:59114 10.134.0.58:443 10.132.0.21:44358 - v1-completions-path 2026-11-02T01:27:04.278343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:27:04.278386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:27:04.278402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:27:04.278407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T01:27:03.914Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 7 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "88066442-97c1-4340-a6dd-6699b084a717" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.58:443 10.132.0.21:44374 - - [2026-11-02T01:27:04.215Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 62 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "6b8315ed-7d38-434a-8f30-e296418d30eb" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:59320 10.134.0.58:443 10.132.0.21:44378 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T01:27:11.415851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:27:26.101725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:29:39.899601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:29:39.899703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:29:39.899748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:29:39.899771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T01:29:39.809Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 89 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "3f818e88-a94e-4027-8b99-a46b583657a3" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:46304 10.134.0.58:443 10.132.0.21:48196 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T01:30:10.855Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 31 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "c84f3dd3-f954-4597-bf1c-b2d5f1637c96" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.58:443 10.132.0.21:58586 - - 2026-11-02T01:30:34.028758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:30:44.152763Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": context deadline exceeded 2026-11-02T01:30:45.194461Z warn xdsproxy sendDownstreamDelta took 10.977604164s 2026-11-02T01:31:35.404568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:32:08.135039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:33:10.735888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:33:28.315342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:34:05.917019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:35:17.584170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:38:22.979911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:39:09.654440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:49:34.854685Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T01:49:57.790028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:49:57.790066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:49:57.790083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T01:49:57.790088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T01:49:57.725Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 64 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "70164d03-e4c7-4f46-b5d5-8d9cba68c905" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:34486 10.134.0.58:443 10.132.0.21:49912 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T01:49:58.178331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:50:19.417940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:03.790151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:51:03.790193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:51:03.790212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:51:03.790218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T01:51:03.728Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 61 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "8720d819-1a16-4f28-b103-f5d520914415" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:41440 10.134.0.58:443 10.132.0.21:60200 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T01:51:06.844218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T01:51:09.955Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 74 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "15dd6cd6-3051-4d2d-8fc4-b6ca3fb55f89" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:38438 10.134.0.58:443 10.132.0.21:60220 - v1-completions-path 2026-11-02T01:51:22.713990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:24.459682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:41.464671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:43.311783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:46.016343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:54.506747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T01:52:01.306Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "fb68843c-77f0-4cfd-88ed-6e585548a9fc" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:38438 10.134.0.58:443 10.132.0.21:57776 - v1-completions-path [2026-11-02T01:52:01.979Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "e22145a7-ed01-4b83-bbf3-c0e811195741" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:38438 10.134.0.58:443 10.132.0.21:57780 - v1-completions-path [2026-11-02T01:52:03.506Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "2c748ed2-4377-40cb-a021-dc6c43bc1eaf" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:41686 10.134.0.58:443 10.132.0.21:57796 - v1-completions-path 2026-11-02T01:52:04.326810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T01:52:04.268Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 58 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "eb4a9af3-c63d-4820-8422-82a696cfc31a" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:41686 10.134.0.58:443 10.132.0.21:57800 - v1-completions-path 2026-11-02T01:52:19.263858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:52:29.446451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:52:31.161476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T01:52:38.001Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "187a44ef-ebdf-48e4-a8d8-b0e6a0a4c120" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:41686 10.134.0.58:443 10.132.0.21:43544 - v1-completions-path 2026-11-02T01:52:50.011549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:52:51.808821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T01:52:56.640Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 292 74 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "2ba0c23b-bc89-4a86-bf35-59d2f32ae85b" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.134.0.58:43454 10.134.0.58:443 10.132.0.21:58020 - v1-completions-path 2026-11-02T01:53:08.223510Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:10.371051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:26.987161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:28.697862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:44.746216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:55.466954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:58.100463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:54:20.613885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:54:34.996459Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T01:54:38.826523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:54:49.067215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:55:04.979086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:55:07.346081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:56:38.791202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:56:41.194612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:58:05.380828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:58:20.378252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:58:22.088846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:58:39.167728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:59:54.967344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:59:54.967383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:59:54.967400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:59:54.967405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T01:59:54.892Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 75 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "c3d6c3cb-8eee-432d-9c97-2c40e5492815" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:52800 10.134.0.58:443 10.132.0.21:39880 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T01:59:56.509039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:59:56.509075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:59:56.509088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T01:59:56.509092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T01:59:56.438Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 70 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "d528d7cf-19ce-493e-ad23-6cd60a6eb618" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:52812 10.134.0.58:443 10.132.0.21:39888 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T02:00:00.859351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:16.643811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:32.810033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:44.475974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:47.912854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T02:00:47.912893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T02:00:47.912909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T02:00:47.912914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T02:00:48.114351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T02:00:47.847Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 65 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "e9a428be-f5d6-45d6-97fc-e002ee8cee9a" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.58:52812 10.134.0.58:443 10.132.0.21:40016 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T02:00:59.654336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:01:01.971308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:01:19.929652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:07.547836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:12.906040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T02:04:16.487Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 57 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "140c3eef-4803-4fa7-b0a8-62c53fad8595" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.58:443 10.132.0.21:34536 - v1-catch-all-path 2026-11-02T02:04:28.170820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:29.746252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:43.965367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:54.703397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8