2026-11-03T21:38:02.520855Z info FLAG: --concurrency="0" 2026-11-03T21:38:02.520904Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T21:38:02.520910Z info FLAG: --help="false" 2026-11-03T21:38:02.520914Z info FLAG: --log_as_json="false" 2026-11-03T21:38:02.520925Z info FLAG: --log_caller="" 2026-11-03T21:38:02.520930Z info FLAG: --log_output_level="default:info" 2026-11-03T21:38:02.520934Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T21:38:02.520945Z info FLAG: --log_target="[stdout]" 2026-11-03T21:38:02.520950Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T21:38:02.520960Z info FLAG: --outlierLogPath="" 2026-11-03T21:38:02.520964Z info FLAG: --profiling="true" 2026-11-03T21:38:02.520967Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T21:38:02.520971Z info FLAG: --proxyLogLevel="warning" 2026-11-03T21:38:02.520981Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T21:38:02.520985Z info FLAG: --stsPort="0" 2026-11-03T21:38:02.520988Z info FLAG: --templateFile="" 2026-11-03T21:38:02.520991Z info FLAG: --tokenManagerPlugin="" 2026-11-03T21:38:02.520996Z info FLAG: --vklog="0" 2026-11-03T21:38:02.521007Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T21:38:02.521232Z info Proxy role ips=[10.132.0.35] type=router id=maas-default-gateway-openshift-default-75d7c785f-6kgrf.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T21:38:02.525018Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T21:38:02.527298Z info cpu limit detected as 2, setting concurrency 2026-11-03T21:38:02.527712Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T21:38:02.527726Z info JWT policy is third-party-jwt 2026-11-03T21:38:02.527730Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T21:38:02.529948Z info Starting default Istio SDS Server 2026-11-03T21:38:02.530485Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T21:38:02.530546Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T21:38:02.530302Z info Opening status port 15020 2026-11-03T21:38:02.531682Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T21:38:02.538062Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T21:38:02.541018Z info Starting proxy agent 2026-11-03T21:38:02.541106Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T21:38:02.557259Z info sds Starting SDS grpc server 2026-11-03T21:38:02.557288Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T21:38:02.606381Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T21:38:02.713996Z info cache generated new workload certificate resourceName=default latency=173.038718ms ttl=23h59m59.286010103s 2026-11-03T21:38:02.714057Z info cache Root cert has changed, start rotating root cert 2026-11-03T21:38:02.714116Z info cache returned workload trust anchor from cache ttl=23h59m59.285885558s 2026-11-03T21:38:02.742082Z info ads ADS: new connection for node:1 2026-11-03T21:38:02.742156Z info cache returned workload certificate from cache ttl=23h59m59.257846098s 2026-11-03T21:38:02.743347Z info ads ADS: new connection for node:2 2026-11-03T21:38:02.743424Z info cache returned workload trust anchor from cache ttl=23h59m59.256576902s 2026-11-03T21:38:02.785094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:38:08.541347Z info Readiness succeeded in 6.034338187s 2026-11-03T21:38:08.541709Z info Envoy proxy is ready 2026-11-03T21:39:27.302372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:29.395430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:35.003516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:37.748089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:39.627008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:42.049646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:39:45.961403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:40:11.837304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:40:18.652461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:40:19.827776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:41:22.844494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:41:22.844537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:41:22.844552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:41:22.844557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T21:41:22.764Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 80 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "d3a9feee-03fa-40f7-90c5-b129e44fd6c7" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:56716 10.132.0.35:443 10.132.0.9:43692 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:41:22.897Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 467 80 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "2eba187d-b211-4908-877b-8fcb39f84559" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:56338 10.132.0.35:443 10.132.0.9:43694 - v1-model-routing [2026-11-03T21:41:23.512Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 50 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "895b58bb-cf59-4c1b-b31f-f9a1eabc34bd" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.9:43708 - v1-model-routing 2026-11-03T21:41:24.097046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:41:24.097083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:41:24.097097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T21:41:24.097101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T21:41:24.087Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 9 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "3aba83de-edac-45bd-b6fd-92282a8516b4" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:56720 10.132.0.35:443 10.132.0.9:43710 - odh-ai-gateway-infra.maas-api-route.4 2026-11-03T21:44:07.976871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:07.976912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:07.976929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:07.976937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T21:44:08.418404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:08.418448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:08.418466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:44:08.418472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T21:44:07.802Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 80 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3f111c84-4dfa-449c-80cb-976c90c794ca" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.35:443 10.132.0.9:57884 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:44:07.903Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 73 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "913386e2-02f4-4448-b7a6-78044f9afcd3" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:42142 10.132.0.35:443 10.132.0.9:57890 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:44:08.354Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a07f6d10-1cc9-45ad-8ce3-39bee6c28261" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:42156 10.132.0.35:443 10.132.0.9:57900 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:44:13.118Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 64 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9ff71a33-d15d-439f-9707-a58061a1a32f" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:57302 10.132.0.35:443 10.132.0.9:38182 - v1-completions-path 2026-11-03T21:44:26.471498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:44:43.309508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:49:21.857467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:49:25.314101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:49:25.314245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:49:25.314301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:49:25.314334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T21:49:25.186Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 127 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9fdb08bb-7627-42e4-a059-ec83cd29264a" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:58066 10.132.0.35:443 10.132.0.9:46654 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:49:45.823448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:50:27.835127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T21:50:27.897936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:50:27.897969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:50:27.897985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:50:27.897990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T21:50:27.829Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 68 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "41f6aa20-e150-4734-a188-ca177f888a5c" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:39902 10.132.0.35:443 10.132.0.9:53812 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:50:35.701153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:50:52.775801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:50:57.518395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:51:04.047261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:51:04.047296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:51:04.047310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:51:04.047315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T21:51:03.827Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "33c46ab8-5465-4a05-a92b-b8f16a56ea67" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.9:39566 - v1-completions-path [2026-11-03T21:51:03.982Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 65 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2be931b6-08a7-45de-8c88-ba0b21668c77" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:35942 10.132.0.35:443 10.132.0.9:39572 - v1-catch-all-path 2026-11-03T21:51:16.024295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:51:32.077468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T21:51:43.117Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "42350922-429a-47af-9907-898b93fc3759" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:39182 10.132.0.35:443 10.132.0.9:50512 - v1-completions-path 2026-11-03T21:51:44.160432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T21:51:44.110Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 53 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "b664f1ec-36fa-4e0b-b5e6-0327363c8f21" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:35942 10.132.0.35:443 10.132.0.9:50520 - v1-completions-path [2026-11-03T21:51:45.105Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a46dc48b-1624-41b9-ad36-bdda54d011be" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:35942 10.132.0.35:443 10.132.0.9:50534 - v1-completions-path 2026-11-03T21:52:01.073150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:52:11.554202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:52:16.015094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:52:35.992055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:52:38.399405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:52:56.762265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:53:01.198844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:53:19.964304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:53:22.356855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:53:39.988001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T21:53:48.758Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "47e62c07-3b26-482e-b1c0-b6f120f438a0" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:57302 10.132.0.35:443 10.132.0.9:41488 - v1-completions-path 2026-11-03T21:54:01.596515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:54:05.474899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:54:12.135202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:54:12.135239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:54:12.135254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:54:12.135258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T21:54:12.068Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 66 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ed87a560-5f02-4d47-b118-3ba49496aa3b" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:55486 10.132.0.35:443 10.132.0.9:47762 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:54:22.779Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 44 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1aa042ba-5e68-4b6b-8480-8cb0cc4989d9" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.9:60390 - v1-completions-path 2026-11-03T21:54:24.937799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:54:27.899465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:54:33.939502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:54:33.939538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:54:33.939551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:54:33.939557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T21:54:33.875Z] "DELETE /v1/api-keys/c56f5069-ea4d-4e64-b765-734560d3a706 HTTP/1.1" 200 - via_upstream - "-" 0 375 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "40808699-1988-400c-99cc-8b562ea11400" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:55486 10.132.0.35:443 10.132.0.9:35754 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:54:40.675579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:54:58.551943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:55:08.894688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:55:28.915434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:55:32.506292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:57:14.655279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:57:18.214639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:58:47.634559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:59:02.969600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:59:05.504871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T21:59:24.123135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:00:57.876269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:00:57.876308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:00:57.876325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:00:57.876330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T22:00:57.807Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 68 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "6b6c9cf6-8533-42b8-9311-26a843f570e7" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:57324 10.132.0.35:443 10.132.0.9:33588 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:01:05.313466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:01:20.898262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:01:36.637009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:01:50.600355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:01:56.024872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:01:58.600190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:01:58.600239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:01:58.600261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:01:58.600269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T22:01:58.500Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 100 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1198e96d-a646-419d-8e20-815e92b95fc1" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:57574 10.132.0.35:443 10.132.0.9:55562 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:02:10.606377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:02:24.117691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T22:02:28.749Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4e4bfaf0-4cee-4816-bfcd-98003ac1ec25" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.9:53974 - v1-completions-path 2026-11-03T22:02:40.965120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:05:42.181403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:05:50.303723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:05:55.517991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:05:55.518027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:05:55.518039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:05:55.518044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T22:05:55.438Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 316 79 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f89ad22c-5c24-4330-a6c3-0f366c576e6b" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.84:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:44936 10.132.0.35:443 10.132.0.9:54638 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:06:08.258209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:06:10.650805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:06:25.756772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T22:06:36.642572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9