2026-10-30T14:57:03.584948Z info FLAG: --concurrency="0" 2026-10-30T14:57:03.584976Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T14:57:03.584990Z info FLAG: --help="false" 2026-10-30T14:57:03.584995Z info FLAG: --log_as_json="false" 2026-10-30T14:57:03.584999Z info FLAG: --log_caller="" 2026-10-30T14:57:03.585003Z info FLAG: --log_output_level="default:info" 2026-10-30T14:57:03.585009Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T14:57:03.585017Z info FLAG: --log_target="[stdout]" 2026-10-30T14:57:03.585021Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T14:57:03.585024Z info FLAG: --outlierLogPath="" 2026-10-30T14:57:03.585028Z info FLAG: --profiling="true" 2026-10-30T14:57:03.585032Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T14:57:03.585036Z info FLAG: --proxyLogLevel="warning" 2026-10-30T14:57:03.585039Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T14:57:03.585043Z info FLAG: --stsPort="0" 2026-10-30T14:57:03.585046Z info FLAG: --templateFile="" 2026-10-30T14:57:03.585050Z info FLAG: --tokenManagerPlugin="" 2026-10-30T14:57:03.585055Z info FLAG: --vklog="0" 2026-10-30T14:57:03.585059Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T14:57:03.585279Z info Proxy role ips=[10.132.0.43] type=router id=maas-default-gateway-openshift-default-6cc458d887-9vjxl.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T14:57:03.585357Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T14:57:03.587237Z info cpu limit detected as 2, setting concurrency 2026-10-30T14:57:03.587559Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T14:57:03.587575Z info JWT policy is third-party-jwt 2026-10-30T14:57:03.587579Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T14:57:03.589692Z info Starting default Istio SDS Server 2026-10-30T14:57:03.589732Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T14:57:03.589759Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T14:57:03.590425Z info Opening status port 15020 2026-10-30T14:57:03.591130Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T14:57:03.593139Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T14:57:03.594436Z info Starting proxy agent 2026-10-30T14:57:03.594484Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T14:57:03.610151Z info sds Starting SDS grpc server 2026-10-30T14:57:03.610251Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T14:57:03.662876Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T14:57:03.688373Z info cache generated new workload certificate resourceName=default latency=97.640441ms ttl=23h59m59.311631927s 2026-10-30T14:57:03.688409Z info cache Root cert has changed, start rotating root cert 2026-10-30T14:57:03.688457Z info cache returned workload trust anchor from cache ttl=23h59m59.311545018s 2026-10-30T14:57:03.764879Z info ads ADS: new connection for node:1 2026-10-30T14:57:03.764988Z info cache returned workload certificate from cache ttl=23h59m59.235015163s 2026-10-30T14:57:03.765455Z info ads ADS: new connection for node:2 2026-10-30T14:57:03.765564Z info cache returned workload trust anchor from cache ttl=23h59m59.234438309s 2026-10-30T14:57:03.807776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:57:09.606997Z info Readiness succeeded in 6.025201681s 2026-10-30T14:57:09.607335Z info Envoy proxy is ready 2026-10-30T14:57:17.977323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:57:58.671569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:58:00.865654Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:58:03.349165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:58:05.246288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:58:08.563570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:58:11.332349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:58:14.187291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:58:33.012561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:59:07.198166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:59:07.198211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:59:07.198233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:59:07.198241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T14:59:07.086Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 111 - "52.71.36.72,10.132.0.11" "curl/7.76.1" "1b4bf1dc-8bf0-4f47-90b8-ad7905668d00" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:43092 10.132.0.43:443 10.132.0.11:53940 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T14:59:07.817Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "52.71.36.72,10.132.0.11" "curl/7.76.1" "698fd760-7d9a-4d08-9529-67d75fe0cf4e" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.11:49858 - v1-model-routing [2026-10-30T14:59:07.906Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "52.71.36.72,10.132.0.11" "curl/7.76.1" "587ab44d-be0f-4bde-ae0e-66aafc6b19b7" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.11:49868 - v1-model-routing [2026-10-30T14:59:08.244Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "52.71.36.72,10.132.0.11" "curl/7.76.1" "cde3b622-8b09-4bed-874c-f30a065b7156" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.11:49882 - v1-model-routing 2026-10-30T15:01:10.301433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:10.301468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:10.301482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:10.301488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T15:01:10.842204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:10.842236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:10.842252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T15:01:10.842257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T15:01:10.198Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 103 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "7f52678a-763e-4ca5-a97d-c55ee1667611" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:53050 10.132.0.43:443 10.132.0.11:47774 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:01:10.757Z] "DELETE /v1/api-keys/65809111-4412-4fae-b417-892823517cd0 HTTP/1.1" 200 - via_upstream - "-" 0 321 84 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "24b45828-caa2-4829-830d-5b3ec038fa0d" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:53050 10.132.0.43:443 10.132.0.11:47778 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T15:01:11.541659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:11.541701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:11.541711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T15:01:11.541730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:11.541738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T15:01:12.142274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:12.142313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:12.142329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:01:12.142334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T15:01:11.458Z] "DELETE /v1/api-keys/c991a240-8c91-44a8-9dab-1b6933ce6163 HTTP/1.1" 200 - via_upstream - "-" 0 321 83 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "8266d552-4f4a-44b0-8632-0d954de7e605" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:53050 10.132.0.43:443 10.132.0.11:47780 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:01:11.967Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 58 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "facfdf28-1a2e-44db-b80c-4cf0d146b6ee" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.43:443 10.132.0.11:47790 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:01:12.053Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 89 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "ca5d470f-55cc-4f30-9ac8-82f456fc660e" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:53050 10.132.0.43:443 10.132.0.11:47804 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:01:18.562Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "69ca1ce1-8869-4a0e-bc11-b35b419715f1" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.11:47660 - v1-completions-path [2026-10-30T15:01:22.593Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 74 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "049357be-f679-41d4-9e40-5bd4c295c503" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59550 10.132.0.43:443 10.132.0.11:47682 - v1-completions-path [2026-10-30T15:01:23.066Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 6 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "45cbf7d5-0d97-46d9-9709-4fec9b88a61d" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.43:443 10.132.0.11:47684 - - [2026-10-30T15:01:50.739Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 69 - "52.71.36.72,10.132.0.11" "-" "bc747cfe-55d6-4a45-a4be-b3f5b3189893" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:52806 10.132.0.43:443 10.132.0.11:51078 - v1-completions-path 2026-10-30T15:05:28.298925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:05:28.298966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:05:28.298983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T15:05:28.298989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T15:05:28.288Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 10 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "7dea4c7a-fb69-487a-9993-4d5f8f1ef76b" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:42006 10.132.0.43:443 10.132.0.11:46464 - odh-ai-gateway-infra.maas-api-route.4 [2026-10-30T15:05:31.264Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 10 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "df77394f-6384-4af9-b6dd-55a4761cd473" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.43:443 10.132.0.11:46476 - - 2026-10-30T15:06:20.414734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:08:02.139291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:09:02.087260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:09:29.598328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:11:00.693551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:27:27.638090Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T15:40:16.359365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:40:16.359401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:40:16.359416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:40:16.359421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T15:40:16.250Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 108 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "b3de5d6e-faef-499b-88bd-6fa5cb5514e0" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:43890 10.132.0.43:443 10.132.0.11:53256 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:40:16.385Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 74 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "ee7ef1b6-2a23-4f94-8e89-4aa8224fe030" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59550 10.132.0.43:443 10.132.0.11:53264 - v1-chat-completions-path 2026-10-30T15:42:44.551339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:42:46.535222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:42:46.535271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:42:46.535291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:42:46.535298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T15:42:46.449Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 86 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "90a02669-ffa7-4566-9ded-879b018f3852" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:52504 10.132.0.43:443 10.132.0.11:54154 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T15:43:10.991754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:43:54.950590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:44:13.216166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:44:17.065010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:44:24.466470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T15:44:24.397Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 69 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "ec676009-2a61-4104-8947-aa5c59bed959" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.11:38842 - v1-completions-path 2026-10-30T15:44:34.107702Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T15:44:36.893766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:44:39.674854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:44:42.675059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:44:52.857915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:45:02.844114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:45:02.844150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:45:02.844166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:45:02.844171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T15:45:02.770Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 73 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "10a15dd9-bb26-4546-a878-8123e53e1a96" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:52214 10.132.0.43:443 10.132.0.11:57228 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:45:04.373Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "1bf4740c-136f-4dbf-9c2c-a3cafd814b58" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:51644 10.132.0.43:443 10.132.0.11:57244 - v1-completions-path [2026-10-30T15:45:05.263Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "bc279b61-f9d5-4c30-b263-f74ea68f0971" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:51644 10.132.0.43:443 10.132.0.11:57248 - v1-completions-path 2026-10-30T15:45:21.477378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:45:32.064790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:45:36.536686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:45:40.245781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:45:40.245819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:45:40.245868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:45:40.245879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T15:45:40.166Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 79 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "2ca579ad-d58f-4b2e-a106-742f5b068ecd" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:55694 10.132.0.43:443 10.132.0.11:34004 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:45:40.437Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "90451625-fb7b-4b89-b328-d83d2d8b6efe" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:58228 10.132.0.43:443 10.132.0.11:34016 - v1-completions-path [2026-10-30T15:45:40.794Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "c2ab6614-be81-4801-bc51-2b2004164c87" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:58228 10.132.0.43:443 10.132.0.11:34018 - v1-completions-path [2026-10-30T15:45:40.952Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "659f63e6-24a8-472e-85c5-14f78a2d91a2" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:58228 10.132.0.43:443 10.132.0.11:34024 - v1-completions-path 2026-10-30T15:45:53.630566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:45:55.925027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:46:15.343210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T15:46:17.150Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 69 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "2831a192-4a19-4b4e-9d5d-af9acad11a5c" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:52806 10.132.0.43:443 10.132.0.11:40510 - v1-completions-path 2026-10-30T15:46:20.001501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:46:35.726672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:46:38.092246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:46:55.908818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:47:07.370953Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:47:10.878770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:47:28.874626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:47:31.796293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T15:47:36.897Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 59 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "b335c263-05da-4d88-ba16-a961850dc283" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59550 10.132.0.43:443 10.132.0.11:58320 - v1-completions-path 2026-10-30T15:47:52.837459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:47:55.680440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:49:33.361373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:49:36.097921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:51:07.500458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:51:22.741117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:51:24.890969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:51:27.829880Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T15:51:27.829916Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T15:51:27.829921Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T15:51:27.829927Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T15:51:27.789Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 40 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "3ea1e80d-0e47-429f-901e-e09bb0cb2bff" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.11:38082 - v1-completions-path 2026-10-30T15:51:39.800581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:52:57.298308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:53:14.580815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:53:27.960446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:53:27.960488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:53:27.960505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:53:27.960510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T15:53:27.905Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 630 55 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "9cc3e536-51a2-4e57-8275-502b56fdc191" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:41814 10.132.0.43:443 10.132.0.11:32856 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T15:53:29.890573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:53:41.866264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:53:46.931594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:53:49.783301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:54:01.178325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:54:04.809369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:54:09.688852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:54:09.688899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:54:09.688928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T15:54:09.688935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T15:54:09.635Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 525 53 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "43d717bd-c865-40cc-ae38-d54b9ad1e716" "maas.apps.d3de2b7c5deea4108ea9.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:45530 10.132.0.43:443 10.132.0.11:48962 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T15:54:21.679773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:54:31.829506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:54:40.149600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:54:53.591019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:54:55.765002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:55:10.346598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:55:21.238432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8