2026-10-30T15:50:07.721568Z info FLAG: --concurrency="0" 2026-10-30T15:50:07.721586Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T15:50:07.721590Z info FLAG: --help="false" 2026-10-30T15:50:07.721593Z info FLAG: --log_as_json="false" 2026-10-30T15:50:07.721595Z info FLAG: --log_caller="" 2026-10-30T15:50:07.721597Z info FLAG: --log_output_level="default:info" 2026-10-30T15:50:07.721599Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T15:50:07.721604Z info FLAG: --log_target="[stdout]" 2026-10-30T15:50:07.721606Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T15:50:07.721608Z info FLAG: --outlierLogPath="" 2026-10-30T15:50:07.721610Z info FLAG: --profiling="true" 2026-10-30T15:50:07.721614Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T15:50:07.721616Z info FLAG: --proxyLogLevel="warning" 2026-10-30T15:50:07.721618Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T15:50:07.721620Z info FLAG: --stsPort="0" 2026-10-30T15:50:07.721622Z info FLAG: --templateFile="" 2026-10-30T15:50:07.721624Z info FLAG: --tokenManagerPlugin="" 2026-10-30T15:50:07.721626Z info FLAG: --vklog="0" 2026-10-30T15:50:07.721629Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T15:50:07.721776Z info Proxy role ips=[10.134.0.36] type=router id=maas-default-gateway-openshift-default-9dccdc9b7-l7x5w.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T15:50:07.721824Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T15:50:07.722883Z info cpu limit detected as 2, setting concurrency 2026-10-30T15:50:07.723532Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T15:50:07.723544Z info JWT policy is third-party-jwt 2026-10-30T15:50:07.723547Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T15:50:07.725443Z info Starting default Istio SDS Server 2026-10-30T15:50:07.725464Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T15:50:07.725487Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T15:50:07.725999Z info Opening status port 15020 2026-10-30T15:50:07.726728Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T15:50:07.727268Z info sds Starting SDS grpc server 2026-10-30T15:50:07.727284Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T15:50:07.728117Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T15:50:07.728979Z info Starting proxy agent 2026-10-30T15:50:07.729010Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T15:50:07.792575Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T15:50:07.900703Z info ads ADS: new connection for node:1 2026-10-30T15:50:07.901335Z info ads ADS: new connection for node:2 2026-10-30T15:50:07.941610Z info cache generated new workload certificate resourceName=default latency=214.185666ms ttl=23h59m59.058394373s 2026-10-30T15:50:07.941643Z info cache Root cert has changed, start rotating root cert 2026-10-30T15:50:07.941675Z info cache returned workload certificate from cache ttl=23h59m59.05833026s 2026-10-30T15:50:07.941683Z info cache returned workload trust anchor from cache ttl=23h59m59.058317473s 2026-10-30T15:50:07.941766Z info cache returned workload trust anchor from cache ttl=23h59m59.0582346s 2026-10-30T15:50:07.942102Z info cache returned workload trust anchor from cache ttl=23h59m59.057898959s 2026-10-30T15:50:08.022623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:50:15.906386Z info Readiness succeeded in 8.187340821s 2026-10-30T15:50:15.907017Z info Envoy proxy is ready [2026-10-30T15:50:25.430Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 397 85 - "52.71.36.72,10.132.0.22" "curl/7.76.1" "6ead5e3a-6180-4fdd-b3bf-eb15abc854b6" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:54786 10.134.0.36:443 10.132.0.22:51098 - v1-model-routing 2026-10-30T15:50:26.487415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:50:26.487453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:50:26.487469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T15:50:26.487473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T15:50:26.414Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 73 - "52.71.36.72,10.132.0.22" "curl/7.76.1" "f86fc15d-c9e9-46e7-a984-4d5b5ac003e1" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:38120 10.134.0.36:443 10.132.0.22:51124 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T15:53:02.100024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:53:02.100060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:53:02.100074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:53:02.100079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T15:53:02.008Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 91 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "aaa2b194-108a-466a-bb9f-b277d07c228d" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:48068 10.134.0.36:443 10.132.0.22:55576 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:53:02.229Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 66 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "80cfd573-5c46-40a9-8d96-df7bd25c8907" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.36:443 10.132.0.22:55586 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T15:53:04.086Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 7 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "8c5fed63-4c4f-4899-91a5-6e58365eb82b" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.36:443 10.132.0.22:55602 - - [2026-10-30T15:53:06.413Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 70 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "1922b811-4e23-4a1d-8719-0311ee8af6b1" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:54786 10.134.0.36:443 10.132.0.22:55624 - v1-completions-path 2026-10-30T15:53:17.021324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:53:17.021380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T15:53:17.021399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T15:53:17.021405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T15:53:16.932Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 89 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "d9d82994-49e1-4616-90d1-caefb771ad2a" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:48068 10.134.0.36:443 10.132.0.22:54614 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T15:53:24.797855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T15:53:42.079131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T15:57:40.618Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 25 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "17ca1e04-18fe-4c55-a6bc-db6df5ee029d" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.36:443 10.132.0.22:49566 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:00:15.508131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:00:41.434876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:00:52.825250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:00:52.825284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:00:52.825295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:00:52.825300Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T16:00:52.746Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 79 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "b81063a9-3590-4012-a2e7-0872b40785f7" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:51588 10.134.0.36:443 10.132.0.22:48634 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:01:20.020731Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T16:01:20.020757Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T16:01:20.020760Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T16:01:20.020764Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T16:01:19.981Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 39 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "b49a628f-a674-4958-9584-f45c9c9f8010" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.22:60422 - v1-completions-path 2026-10-30T16:01:25.126583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T16:01:29.904Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 72 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "1fcc1d49-d50c-44cc-ac1b-016fda0de7b5" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:46470 10.134.0.36:443 10.132.0.22:34342 - v1-completions-path 2026-10-30T16:01:42.474148Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:01:47.139190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T16:01:50.366Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "a7b0c31a-5f13-42ec-9d6e-ac706194b0f8" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.22:45554 - v1-completions-path 2026-10-30T16:02:03.520869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:02:07.188729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:02:18.437893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T16:02:24.760Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "927a6035-64f1-47da-800b-a52c374dc474" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:45450 10.134.0.36:443 10.132.0.22:48688 - v1-completions-path [2026-10-30T16:02:25.590Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "e3e19e3c-77e5-4c44-91ad-4d90a5c4f659" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:46470 10.134.0.36:443 10.132.0.22:48692 - v1-completions-path 2026-10-30T16:02:26.513683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T16:02:26.432Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 85 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "d59f1e95-e970-4745-b6f7-19c79400597f" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:46470 10.134.0.36:443 10.132.0.22:48698 - v1-completions-path 2026-10-30T16:02:41.856927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:02:52.238867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:02:57.003454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:03:01.223335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T16:03:01.166Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "687c830a-793e-4904-b6de-279d0c2802cb" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:45450 10.134.0.36:443 10.132.0.22:45226 - v1-completions-path 2026-10-30T16:03:13.918611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:03:16.321572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:03:35.763764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:03:40.311081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:03:57.537594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:04:13.743472Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:04:24.437237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:04:27.440296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:04:46.641370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:04:49.631176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T16:04:56.359Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 31 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "fd2d5f4d-f4fe-4277-8c36-b436ba2fe1c2" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.22:37096 - v1-completions-path 2026-10-30T16:05:10.484942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:05:13.365152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:06:39.040944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:06:39.040998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:06:39.041021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:06:39.041028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T16:06:38.952Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 89 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "676d9336-e3b1-4bf9-8e5a-02d2297648af" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:58256 10.134.0.36:443 10.132.0.22:38626 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:06:52.007133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:06:55.352942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:08:25.197251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T16:08:27.632Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 294 117 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "ef722875-4d22-4709-a737-8d8ffb316a32" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:36010 10.134.0.36:443 10.132.0.22:44334 - v1-completions-path 2026-10-30T16:08:40.563478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:08:42.864441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:08:57.293092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:10:17.949018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:10:36.047479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:10:50.938359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:11:05.430431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:11:09.313672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:11:09.334161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:11:09.334239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:11:09.334280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:11:09.334303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T16:11:09.206Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 127 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "fb361373-a079-45f1-a3a6-db2de031c44c" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:35932 10.134.0.36:443 10.132.0.22:59326 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:11:21.319639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:11:24.895937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:11:45.139383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:11:55.085674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:12:00.507429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:12:00.507465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:12:00.507480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:12:00.507484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:12:00.598838Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T16:12:00.422Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 85 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "f7f9a8e1-d4e8-4df8-88fd-c4b954253577" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47574 10.134.0.36:443 10.132.0.22:44962 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:12:00.527Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 71 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "f00fa08b-74ad-40ec-893d-e504285d6118" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:32962 10.134.0.36:443 10.132.0.22:44978 - v1-catch-all-path 2026-10-30T16:12:03.346638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:12:09.086383Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T16:12:09.025Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 61 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "5e4bc967-2ba1-48df-a1fa-171a34bcb254" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:32962 10.134.0.36:443 10.132.0.22:45002 - v1-catch-all-path 2026-10-30T16:12:16.965189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:12:19.256763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:12:21.762995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:12:21.763035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:12:21.763049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:12:21.763054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:12:21.876959Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T16:12:21.557Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 205 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "81c877cb-5ae8-455f-aced-0f5a1749d987" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.134.0.100:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:42230 10.134.0.36:443 10.132.0.22:47666 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:12:21.806Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 70 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "726e0a85-99d0-476b-96e1-76e9fae0ec46" "maas.apps.72ebd9059fe6f849b05f.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51616 10.134.0.36:443 10.132.0.22:47678 - v1-catch-all-path 2026-10-30T16:12:33.859942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:12:44.930767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8