2026-10-30T19:26:36.926068Z info FLAG: --concurrency="0" 2026-10-30T19:26:36.926088Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T19:26:36.926093Z info FLAG: --help="false" 2026-10-30T19:26:36.926096Z info FLAG: --log_as_json="false" 2026-10-30T19:26:36.926099Z info FLAG: --log_caller="" 2026-10-30T19:26:36.926102Z info FLAG: --log_output_level="default:info" 2026-10-30T19:26:36.926105Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T19:26:36.926111Z info FLAG: --log_target="[stdout]" 2026-10-30T19:26:36.926114Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T19:26:36.926117Z info FLAG: --outlierLogPath="" 2026-10-30T19:26:36.926120Z info FLAG: --profiling="true" 2026-10-30T19:26:36.926123Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T19:26:36.926126Z info FLAG: --proxyLogLevel="warning" 2026-10-30T19:26:36.926129Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T19:26:36.926132Z info FLAG: --stsPort="0" 2026-10-30T19:26:36.926134Z info FLAG: --templateFile="" 2026-10-30T19:26:36.926137Z info FLAG: --tokenManagerPlugin="" 2026-10-30T19:26:36.926141Z info FLAG: --vklog="0" 2026-10-30T19:26:36.926144Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T19:26:36.926323Z info Proxy role ips=[10.133.0.37] type=router id=maas-default-gateway-openshift-default-75bf867b6c-n5rx6.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T19:26:36.926388Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T19:26:36.927646Z info cpu limit detected as 2, setting concurrency 2026-10-30T19:26:36.927886Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T19:26:36.927899Z info JWT policy is third-party-jwt 2026-10-30T19:26:36.927904Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T19:26:36.929194Z info Starting default Istio SDS Server 2026-10-30T19:26:36.929221Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T19:26:36.929239Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T19:26:36.929661Z info Opening status port 15020 2026-10-30T19:26:36.931128Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T19:26:36.932487Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T19:26:36.933275Z info Starting proxy agent 2026-10-30T19:26:36.933306Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T19:26:36.941875Z info sds Starting SDS grpc server 2026-10-30T19:26:36.941897Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T19:26:37.006873Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T19:26:37.038031Z info cache generated new workload certificate resourceName=default latency=106.522254ms ttl=23h59m59.961972088s 2026-10-30T19:26:37.038072Z info cache Root cert has changed, start rotating root cert 2026-10-30T19:26:37.038112Z info cache returned workload trust anchor from cache ttl=23h59m59.961888858s 2026-10-30T19:26:37.121539Z info ads ADS: new connection for node:1 2026-10-30T19:26:37.121620Z info cache returned workload certificate from cache ttl=23h59m59.878382217s 2026-10-30T19:26:37.121854Z info ads ADS: new connection for node:2 2026-10-30T19:26:37.121940Z info cache returned workload trust anchor from cache ttl=23h59m59.878061753s 2026-10-30T19:26:37.208338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:26:42.316763Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-10-30T19:26:45.399866Z info Readiness succeeded in 8.476843901s 2026-10-30T19:26:45.400185Z info Envoy proxy is ready [2026-10-30T19:26:54.038Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 416 105 - "52.71.36.72,10.132.0.13" "curl/7.76.1" "42fe4afa-61f0-49bd-ac09-fbe31024c7a7" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:57318 10.133.0.37:443 10.132.0.13:47798 - v1-model-routing 2026-10-30T19:26:55.808637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:26:55.808676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:26:55.808692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:26:55.808696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T19:26:55.722Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 86 - "52.71.36.72,10.132.0.13" "curl/7.76.1" "d5525679-2e13-4d4c-8cb6-e45d4ec8fa52" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:46582 10.133.0.37:443 10.132.0.13:47810 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:29:26.086182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:26.086219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:26.086232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:29:26.086237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:26.407570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:26.407615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:26.407638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:26.407646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T19:29:25.917Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 52 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "37af14ff-860e-41df-a30d-6cad73ecc971" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.37:443 10.132.0.13:59000 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:29:26.023Z] "DELETE /v1/api-keys/6798cd1d-448b-477a-b8d3-63dbf8f2b8fc HTTP/1.1" 200 - via_upstream - "-" 0 370 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "4bdf2322-33cd-4cc4-925f-6559ec74a76e" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:56914 10.133.0.37:443 10.132.0.13:59002 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:29:26.348Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "10ad454b-7cd0-4b09-98a0-d163492dc4ae" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:56930 10.133.0.37:443 10.132.0.13:59016 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:29:26.522221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:26.522263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:26.522286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:29:26.522294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:27.356223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:27.356337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:27.356395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:29:27.356428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T19:29:26.465Z] "DELETE /v1/api-keys/888a002c-728b-47bc-9563-3895439e846d HTTP/1.1" 200 - via_upstream - "-" 0 321 56 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "a0e8e02b-45f1-48b6-b6a4-a66fa172d78a" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:56914 10.133.0.37:443 10.132.0.13:59022 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:29:27.282Z] "DELETE /v1/api-keys/6af26a22-0fea-40c4-ba6c-6ad7f96730b5 HTTP/1.1" 200 - via_upstream - "-" 0 321 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "4949e6c2-15ee-4828-b94b-8c0161e9e110" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:56914 10.133.0.37:443 10.132.0.13:59026 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:29:28.903872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:28.903905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:28.903919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:28.903924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T19:29:28.819Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 84 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6450ef77-c2b7-4dd7-acd2-186e3a364b34" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:56914 10.133.0.37:443 10.132.0.13:59038 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:29:29.805052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:29.805101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:29.805112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T19:29:29.805132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:29:29.805138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T19:29:29.648Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 157 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9d12b282-68b3-459f-b7e6-c5d8f9c1f44e" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:56914 10.133.0.37:443 10.132.0.13:59054 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:29:31.229915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:31.229961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:31.229981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T19:29:31.229987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T19:29:31.137Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 92 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "d697a4ca-c130-4219-ae37-1f72b35c6575" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:56930 10.133.0.37:443 10.132.0.13:59060 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:29:38.469151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:38.469192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:38.469209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:29:38.469213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T19:29:37.660Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 8 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5a3a18aa-219d-4998-9532-0004cef26386" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.37:443 10.132.0.13:51686 - - [2026-10-30T19:29:38.410Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 58 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "a74110f4-84ee-4606-9278-dee8071b3f37" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:56914 10.133.0.37:443 10.132.0.13:51690 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:29:58.281388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:30:13.375824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:33:51.184331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:34:15.550905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:35:03.198939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T19:35:07.132Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 77 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7b12d244-35cf-4b9e-9a0d-9561ca810ceb" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40784 10.133.0.37:443 10.132.0.13:52034 - v1-completions-path 2026-10-30T19:35:18.923916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:35:20.576401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:35:37.659851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:35:39.423091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:35:42.155166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:35:50.961824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:35:54.033575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:35:54.033614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:35:54.033633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:35:54.033639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T19:35:53.962Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 71 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "0d8fa3d1-8e16-4ee2-941f-ccf1bcc5cdce" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:37704 10.133.0.37:443 10.132.0.13:59398 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:35:54.366Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 56 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c4d2ce1b-c696-45ef-be78-78fe7d97a97b" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40784 10.133.0.37:443 10.132.0.13:59414 - v1-completions-path [2026-10-30T19:35:55.042Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e6c18100-8e26-448d-b47c-bae3e8888b1d" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.37:443 10.132.0.13:59426 - v1-completions-path 2026-10-30T19:35:56.678775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T19:35:56.620Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "8062b4db-22f3-42e8-9ec8-d2eb137f4a8a" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40784 10.133.0.37:443 10.132.0.13:59438 - v1-completions-path 2026-10-30T19:36:12.331303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:36:22.509909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:36:24.749461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:36:29.961124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:36:29.961163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:36:29.961181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T19:36:29.961187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T19:36:29.895Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 65 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "37f28c1a-e416-478f-90ec-2b10910e4136" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.37:37704 10.133.0.37:443 10.132.0.13:48966 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:36:30.500Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "14c99fdf-6c84-41f5-be82-2f5f910bf9ca" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40784 10.133.0.37:443 10.132.0.13:48970 - v1-completions-path [2026-10-30T19:36:31.587Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "04f576e9-e0e5-476a-950b-517e98d0b876" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:50002 10.133.0.37:443 10.132.0.13:48978 - v1-completions-path 2026-10-30T19:36:43.306481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:36:44.939333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:37:01.743492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:37:03.829358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:37:20.335327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:37:22.094377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:37:38.144610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:37:48.860519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:37:51.436851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T19:38:09.778Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 64 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1ed336b5-6367-4ba8-b74d-ee1cd51cb894" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:46608 10.133.0.37:443 10.132.0.13:54426 - v1-completions-path [2026-10-30T19:38:09.903Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "49a2baac-f0ae-4452-8ab6-29313aa12c5b" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.37:443 10.132.0.13:54432 - v1-completions-path 2026-10-30T19:38:13.935438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:38:17.240529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T19:38:17.182Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9f063422-6c52-40dc-a4b7-07d55cb0905b" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:50002 10.133.0.37:443 10.132.0.13:58138 - v1-completions-path 2026-10-30T19:38:28.961125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:38:39.207186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:40:26.684845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:40:28.985666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:41:53.297046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:42:07.403061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:42:09.244418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:42:26.442137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:43:54.703216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:44:14.002193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:44:27.959640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:44:39.206418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:44:42.685882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:44:53.749780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:44:56.194372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:45:14.267926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:48:05.145086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:48:10.308951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:48:25.602660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:48:27.219417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:48:30.252956Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T19:48:30.178Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "478e759b-faf4-4e8a-8f91-d7051cf46b8e" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:33684 10.133.0.37:443 10.132.0.13:52942 - v1-catch-all-path 2026-10-30T19:48:41.799468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:48:52.684383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9