2026-10-30T13:02:12.122072Z info FLAG: --concurrency="0" 2026-10-30T13:02:12.122092Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T13:02:12.122097Z info FLAG: --help="false" 2026-10-30T13:02:12.122099Z info FLAG: --log_as_json="false" 2026-10-30T13:02:12.122101Z info FLAG: --log_caller="" 2026-10-30T13:02:12.122103Z info FLAG: --log_output_level="default:info" 2026-10-30T13:02:12.122105Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T13:02:12.122110Z info FLAG: --log_target="[stdout]" 2026-10-30T13:02:12.122113Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T13:02:12.122115Z info FLAG: --outlierLogPath="" 2026-10-30T13:02:12.122117Z info FLAG: --profiling="true" 2026-10-30T13:02:12.122119Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T13:02:12.122120Z info FLAG: --proxyLogLevel="warning" 2026-10-30T13:02:12.122123Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T13:02:12.122125Z info FLAG: --stsPort="0" 2026-10-30T13:02:12.122127Z info FLAG: --templateFile="" 2026-10-30T13:02:12.122129Z info FLAG: --tokenManagerPlugin="" 2026-10-30T13:02:12.122131Z info FLAG: --vklog="0" 2026-10-30T13:02:12.122134Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T13:02:12.122343Z info Proxy role ips=[10.134.0.36] type=router id=maas-default-gateway-openshift-default-5bc884dd87-5x6r5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T13:02:12.122397Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T13:02:12.123595Z info cpu limit detected as 2, setting concurrency 2026-10-30T13:02:12.123863Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T13:02:12.123873Z info JWT policy is third-party-jwt 2026-10-30T13:02:12.123876Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T13:02:12.125729Z info Starting default Istio SDS Server 2026-10-30T13:02:12.125749Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T13:02:12.125772Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T13:02:12.126693Z info Opening status port 15020 2026-10-30T13:02:12.127182Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T13:02:12.127874Z info sds Starting SDS grpc server 2026-10-30T13:02:12.127889Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T13:02:12.128660Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T13:02:12.129479Z info Starting proxy agent 2026-10-30T13:02:12.129507Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T13:02:12.191020Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T13:02:12.207278Z info cache generated new workload certificate resourceName=default latency=79.300048ms ttl=23h59m59.792725562s 2026-10-30T13:02:12.207308Z info cache Root cert has changed, start rotating root cert 2026-10-30T13:02:12.207335Z info cache returned workload trust anchor from cache ttl=23h59m59.792665693s 2026-10-30T13:02:12.302002Z info ads ADS: new connection for node:1 2026-10-30T13:02:12.302070Z info cache returned workload certificate from cache ttl=23h59m59.697931853s 2026-10-30T13:02:12.302358Z info ads ADS: new connection for node:2 2026-10-30T13:02:12.302456Z info cache returned workload trust anchor from cache ttl=23h59m59.697545716s 2026-10-30T13:02:12.381856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:02:20.238438Z info Readiness succeeded in 8.119378628s 2026-10-30T13:02:20.238799Z info Envoy proxy is ready 2026-10-30T13:02:32.667560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:02:32.667600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:02:32.667641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:02:32.667646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T13:02:32.571Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 95 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "afa227cd-71ca-419c-aeed-c9c1661d911d" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:44932 10.134.0.36:443 10.132.0.15:49710 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:02:32.978Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 406 71 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "52764a2d-c5b8-4a21-9701-7037421b5271" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:42068 10.134.0.36:443 10.132.0.15:49722 - v1-model-routing 2026-10-30T13:02:33.846515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:02:33.846552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:02:33.846566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:02:33.846571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:02:33.884376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:02:33.884402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:02:33.884413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:02:33.884418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:02:33.260Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "b760d27b-f042-4a20-8617-00a8af977de1" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.15:49730 - v1-model-routing [2026-10-30T13:02:33.338Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 48 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "c430e5b1-a80e-4178-9c38-c518fba92dc6" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.15:49740 - v1-model-routing [2026-10-30T13:02:33.503Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "c0d81618-23f9-49f1-9a8d-5d2b14e0936f" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.15:49750 - v1-model-routing [2026-10-30T13:02:33.658Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 48 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "1bbe223b-2853-412f-8c7d-07d602854c18" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.15:49756 - v1-model-routing [2026-10-30T13:02:33.778Z] "DELETE /v1/api-keys/6bcf23e8-8f7d-4487-8f8e-a5c878c7c21c HTTP/1.1" 200 - via_upstream - "-" 0 365 67 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "30cd78ac-2760-495d-997a-98e140b32564" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:44940 10.134.0.36:443 10.132.0.15:49766 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:02:33.876Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 7 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "413e00eb-7542-4a24-8279-8ec93734ad94" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:44932 10.134.0.36:443 10.132.0.15:49770 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T13:04:47.904520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:04:47.904554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:04:47.904569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:04:47.904573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T13:04:47.830Z] "DELETE /v1/api-keys/0cd740fd-219d-4f59-a3ba-a8b5e201e5cb HTTP/1.1" 200 - via_upstream - "-" 0 321 74 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "dc3d89c3-65ec-438e-a43b-5d2c503e5f5b" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:57298 10.134.0.36:443 10.132.0.15:41562 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:04:49.394878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:04:49.394912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:04:49.394926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:04:49.394931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:04:49.323Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 70 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "380f9f73-c920-431e-83e9-c69e33ea7ed6" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:57300 10.134.0.36:443 10.132.0.15:60076 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:04:50.344418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:04:50.344462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:04:50.344484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:04:50.344492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:04:50.786992Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T13:04:50.787017Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T13:04:50.787020Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T13:04:50.787025Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T13:04:50.262Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 82 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "dde1c79c-79d3-4ef7-af9d-37fb0b22bc87" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:57298 10.134.0.36:443 10.132.0.15:60078 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:04:50.751Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 35 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "86d56211-e773-476e-8298-4af5a35609ba" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.15:60086 - v1-completions-path 2026-10-30T13:04:59.186112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T13:04:59.124Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 68 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "f99e0dc6-4426-44ac-88fd-6f11dda8c5f7" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:50116 10.134.0.36:443 10.132.0.15:55926 - v1-completions-path 2026-10-30T13:05:08.809268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:05:19.890593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:09:00.639254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:09:00.639308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:09:00.639331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:09:00.639338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T13:09:00.518Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 120 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "279f2f8c-80af-464d-aaa9-ecd5f9e8d3b3" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:44572 10.134.0.36:443 10.132.0.15:47512 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:09:00.845430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:09:00.845465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:09:00.845478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:09:00.845483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:09:00.845698Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-30T13:09:00.845750Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:09:00.845758Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:09:00.845760Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:09:00.845764Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T13:09:00.786Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 59 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "79aa982f-23b0-4df5-8db9-01f7e8c62a19" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:50116 10.134.0.36:443 10.132.0.15:47514 - v1-completions-path 2026-10-30T13:11:01.729444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:11:01.729481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:11:01.729498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:11:01.729503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:11:01.649Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 80 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "afb2ee09-d586-4479-bd7d-2ab677e4e200" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:50666 10.134.0.36:443 10.132.0.15:42744 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:13:50.443672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:14:12.982853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:14:56.422790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:15:00.505Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 70 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "39570be7-429b-4440-bb70-e046feab76ab" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:33072 10.134.0.36:443 10.132.0.15:33146 - v1-completions-path [2026-10-30T13:15:00.903Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "9c86cf8c-7484-41ca-b5e3-8aa4f941a66b" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:33072 10.134.0.36:443 10.132.0.15:33160 - v1-completions-path 2026-10-30T13:15:13.372956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:15:18.607507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:15:36.709672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:15:38.897061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:15:42.052474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:15:52.251119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:15:59.785Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "48e78fa4-8158-4cb4-b54d-461964c94bcf" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:37130 10.134.0.36:443 10.132.0.15:39600 - v1-completions-path 2026-10-30T13:16:16.417064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:16:26.797158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:16:31.160437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:16:49.340278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:16:51.907044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:17:09.809157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:17:14.217744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:17:28.406184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T13:17:28.348Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 59 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "b6b02570-0646-49f6-b14e-93393ca98f5b" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:50116 10.134.0.36:443 10.132.0.15:53772 - v1-completions-path 2026-10-30T13:17:30.784551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:17:46.638970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:17:57.582587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:18:00.800213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:18:19.580114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:18:22.463778Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:18:27.717695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T13:18:27.724946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:18:27.724976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:18:27.724991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:18:27.724996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:18:27.652Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 72 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "3a94e7c4-51f5-48d2-a5fe-7cd7993e1a5b" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:51274 10.134.0.36:443 10.132.0.15:48308 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:18:27.825Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 29 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "9d0ae03a-0861-4fb4-be13-d7ad3b4a12aa" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.132.0.15:48320 - v1-completions-path 2026-10-30T13:18:43.158301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:18:45.807871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:20:24.825183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:20:27.580062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:21:39.288318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:21:39.288360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:21:39.288381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:21:39.288388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:21:39.214Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 73 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "5cd1296d-a765-430f-ae55-dbeb77c0de9c" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:56360 10.134.0.36:443 10.132.0.15:49490 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:21:58.379506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:22:13.646762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:22:15.972131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:22:28.531996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:23:44.164780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:23:44.164814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:23:44.164827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:23:44.164832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:23:44.091Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 73 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "0f3d3903-e15f-4358-bf83-33dae90cb7ac" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:57300 10.134.0.36:443 10.132.0.15:33070 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:23:49.164428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:06.312087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:21.420691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:35.658010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:42.197115Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:54.009747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:58.247526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:04.592652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:25:04.592689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:25:04.592706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:25:04.592711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T13:25:04.541Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 525 51 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "f14bbf80-3d36-4de2-a078-19d8ea9686a1" "maas.apps.a0578ae21487e83412f0.prod.konflux-ocp-ci.dev" "10.132.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:52212 10.134.0.36:443 10.132.0.15:49552 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:25:16.686860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:26.366981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:34.425682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:48.275114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:50.550976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:26:05.401102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:26:16.334978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8