2026-11-02T14:07:39.734839Z info FLAG: --concurrency="0" 2026-11-02T14:07:39.734868Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T14:07:39.734873Z info FLAG: --help="false" 2026-11-02T14:07:39.734875Z info FLAG: --log_as_json="false" 2026-11-02T14:07:39.734877Z info FLAG: --log_caller="" 2026-11-02T14:07:39.734879Z info FLAG: --log_output_level="default:info" 2026-11-02T14:07:39.734881Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T14:07:39.734885Z info FLAG: --log_target="[stdout]" 2026-11-02T14:07:39.734887Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T14:07:39.734889Z info FLAG: --outlierLogPath="" 2026-11-02T14:07:39.734891Z info FLAG: --profiling="true" 2026-11-02T14:07:39.734893Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T14:07:39.734895Z info FLAG: --proxyLogLevel="warning" 2026-11-02T14:07:39.734897Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T14:07:39.734899Z info FLAG: --stsPort="0" 2026-11-02T14:07:39.734901Z info FLAG: --templateFile="" 2026-11-02T14:07:39.734903Z info FLAG: --tokenManagerPlugin="" 2026-11-02T14:07:39.734905Z info FLAG: --vklog="0" 2026-11-02T14:07:39.734908Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T14:07:39.735071Z info Proxy role ips=[10.132.0.43] type=router id=maas-default-gateway-openshift-default-55fbd65575-8q5hv.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T14:07:39.735115Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T14:07:39.736215Z info cpu limit detected as 2, setting concurrency 2026-11-02T14:07:39.736415Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T14:07:39.736425Z info JWT policy is third-party-jwt 2026-11-02T14:07:39.736428Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T14:07:39.737884Z info Starting default Istio SDS Server 2026-11-02T14:07:39.737907Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T14:07:39.737924Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T14:07:39.738300Z info Opening status port 15020 2026-11-02T14:07:39.739259Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T14:07:39.740637Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T14:07:39.741453Z info Starting proxy agent 2026-11-02T14:07:39.741484Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T14:07:39.751037Z info sds Starting SDS grpc server 2026-11-02T14:07:39.751063Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T14:07:39.788554Z info cache generated new workload certificate resourceName=default latency=48.712285ms ttl=23h59m59.211449995s 2026-11-02T14:07:39.788591Z info cache Root cert has changed, start rotating root cert 2026-11-02T14:07:39.788620Z info cache returned workload trust anchor from cache ttl=23h59m59.211380177s 2026-11-02T14:07:39.813409Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T14:07:39.937610Z info ads ADS: new connection for node:1 2026-11-02T14:07:39.937683Z info cache returned workload certificate from cache ttl=23h59m59.062319827s 2026-11-02T14:07:39.939044Z info ads ADS: new connection for node:2 2026-11-02T14:07:39.939137Z info cache returned workload trust anchor from cache ttl=23h59m59.060865376s 2026-11-02T14:07:40.021839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:07:47.922041Z info Readiness succeeded in 8.189475273s 2026-11-02T14:07:47.922531Z info Envoy proxy is ready [2026-11-02T14:08:23.837Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 63 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "752f42cf-8d59-41f9-a1b8-c816696ea18e" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.13:53264 - v1-model-routing 2026-11-02T14:08:51.481796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:51.481834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:51.481848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:51.481853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:08:51.396Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 85 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c3d03fe1-0bc3-43c0-a076-d970547d78df" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:50016 10.132.0.43:443 10.132.0.13:34166 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:08:52.038727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:52.038761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:52.038776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:52.038781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:08:52.210967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:52.211005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:52.211024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:52.211031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:08:52.737713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:08:52.737752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:08:52.737766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:08:52.737771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T14:08:51.968Z] "DELETE /v1/api-keys/4dad8f30-827d-4e11-9262-34530d40b939 HTTP/1.1" 200 - via_upstream - "-" 0 321 70 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "b719e7cb-5d4a-4031-bdd4-bbfaf9d8b771" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:50016 10.132.0.43:443 10.132.0.13:34186 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:08:52.137Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 73 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "bcd9a045-3749-437d-b038-3c572e131d0e" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:50016 10.132.0.43:443 10.132.0.13:34190 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:08:52.639Z] "DELETE /v1/api-keys/45b7a5e7-de8b-4a6f-9256-c78760e0c580 HTTP/1.1" 200 - via_upstream - "-" 0 321 98 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "8ea36865-0499-4bc9-9773-65a848b5be52" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:50028 10.132.0.43:443 10.132.0.13:34194 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:08:53.331528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:53.331575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:53.331597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:08:53.331604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:08:53.252Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 79 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "658b9334-81c7-48d9-9332-4bbeb1211d77" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:50016 10.132.0.43:443 10.132.0.13:34200 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:08:54.746Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 50 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "35005940-843c-4bdd-9a11-09a55931f2e6" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.43:443 10.132.0.13:59764 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:09:03.699784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T14:09:03.891075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:09:03.891107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:09:03.891121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:09:03.891126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T14:09:03.635Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 82 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "8804cd0d-d502-43d3-9c21-b1e83ed5cb7d" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:43344 10.132.0.43:443 10.132.0.13:59784 - v1-completions-path [2026-11-02T14:09:03.818Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 72 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "ab8f9501-c855-4d6c-96de-fe8ab05b0a07" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:50028 10.132.0.43:443 10.132.0.13:59794 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:09:12.683742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:09:22.087712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:09:36.971Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 65 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "5a059954-d4f6-45df-a848-d3e418f62dbd" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:43344 10.132.0.43:443 10.132.0.13:58680 - v1-completions-path [2026-11-02T14:09:37.343Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 8 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "52260259-9ab1-4c2f-8c6a-35bbddbd3c00" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.43:443 10.132.0.13:58684 - - 2026-11-02T14:11:03.467574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:11:03.467611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:11:03.467627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:11:03.467632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T14:11:03.393Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 74 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "dcd7e1e8-271e-4337-b7af-4dfeb984c821" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:51056 10.132.0.43:443 10.132.0.13:42182 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:11:03.621Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 328 91 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "e98c1c8c-ad78-4bda-909f-671a1706b0a4" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:57010 10.132.0.43:443 10.132.0.13:42190 - v1-chat-completions-path 2026-11-02T14:12:33.821329Z info ads ADS: new connection for node:3 2026-11-02T14:12:33.853690Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T14:12:33.853776Z info cache read certificate from file resource=file-root:system 2026-11-02T14:18:07.006111Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:19:07.445525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:19:22.525089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:21:13.509268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:21:38.579772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:21:56.816496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:09.680347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:11.505971Z info ads ADS: new connection for node:4 2026-11-02T14:22:11.506167Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T14:22:11.506202Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T14:22:14.211165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:18.241996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:23.716704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:28.260528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:31.254144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:31.804527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:34.041234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:22:58.757927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:23:05.505691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:23:20.604940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:23:40.612789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:23:43.472084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:23:43.472127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:23:43.472142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:23:43.472147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T14:23:43.354Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 117 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "b3cdcf77-bddf-4673-b548-e0ed50c798c8" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:60804 10.132.0.43:443 10.132.0.13:49920 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:23:45.454196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:23:45.454226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:23:45.454237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:23:45.454241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:23:45.454436Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:23:45.339Z] "POST /anything/e2e-rt-sw-0ec724-client HTTP/1.1" 200 - via_upstream - "-" 124 1766 114 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "94597c64-f5e4-4e16-a701-485d4d519e22" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.43:52264 10.132.0.43:443 10.132.0.13:52230 - llm.external-model-e2e-rt-sw-0ec724-bc1398cbe93f.0 2026-11-02T14:23:50.968089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:23:50.968119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:23:50.968130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:23:50.968135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:23:50.968297Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:23:50.899Z] "POST /llm/e2e-rt-sw-0ec724/anything/e2e-rt-sw-0ec724-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 68 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "31b3b0c4-274b-4f30-8412-2ddb1be3973e" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-0ec724.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.13:52254 - llm.external-model-e2e-rt-sw-0ec724-bc1398cbe93f.2 2026-11-02T14:23:56.510823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:24:07.034257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:07.034309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:07.034327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:07.034333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:24:07.034619Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:24:06.913Z] "POST /anything/e2e-rt-sw-0ec724-client HTTP/1.1" 200 - via_upstream - "-" 124 1760 121 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c6df4942-a422-4e8d-9b06-380c4d759480" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.43:35298 10.132.0.43:443 10.132.0.13:35416 - llm.external-model-e2e-rt-sw-0ec724-bc1398cbe93f.0 2026-11-02T14:24:16.724247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:24:22.689316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T14:24:22.746182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:22.746212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:22.746223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:24:22.746228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:22.746392Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:24:22.681Z] "POST /llm/e2e-rt-sw-0ec724/anything/e2e-rt-sw-0ec724-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 65 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "bce02f5f-3a92-40a1-8473-0d8103b5c652" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-0ec724.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.13:59184 - llm.external-model-e2e-rt-sw-0ec724-bc1398cbe93f.2 2026-11-02T14:24:28.152843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:28.152891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:28.152909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:24:28.152916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:24:28.153640Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:24:28.056Z] "POST /anything/e2e-rt-sw-0ec724-client HTTP/1.1" 200 - via_upstream - "-" 124 1764 97 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "77753f00-ce47-41ed-b16a-5822ede85ed5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.43:35298 10.132.0.43:443 10.132.0.13:47352 - llm.external-model-e2e-rt-sw-0ec724-bc1398cbe93f.0 2026-11-02T14:24:59.992653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:25:03.268228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T14:25:03.268454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:25:03.268474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:25:03.268484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:25:03.268488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:25:03.268649Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:25:03.121Z] "POST /anything/e2e-rt-eq-0c8e39-client HTTP/1.1" 200 - via_upstream - "-" 124 1761 147 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "8ca5fec5-b8fe-41b0-8ebd-2ff2a6055268" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.43:60190 10.132.0.43:443 10.132.0.13:36102 - llm.external-model-e2e-rt-eq-0c8e39-8f80e74632e1.0 2026-11-02T14:25:03.972037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:25:03.972070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:25:03.972083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:25:03.972087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:25:03.972309Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:25:03.870Z] "POST /anything/e2e-rt-eq-0c8e39-client HTTP/1.1" 200 - via_upstream - "-" 124 1760 101 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c150efa3-13b7-43dc-a67f-b2591a891fa0" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.43:60200 10.132.0.43:443 10.132.0.13:36120 - llm.external-model-e2e-rt-eq-0c8e39-8f80e74632e1.2 2026-11-02T14:25:08.230254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:25:08.230297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:25:08.230310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:25:08.230315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:25:08.230503Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:25:08.132Z] "POST /anything/e2e-rt-eq-0c8e39-client HTTP/1.1" 200 - via_upstream - "-" 124 1759 97 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "152b5a39-97a4-4a5f-a144-656a925f874a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.43:58156 10.132.0.43:443 10.132.0.13:48576 - llm.external-model-e2e-rt-eq-0c8e39-8f80e74632e1.0 2026-11-02T14:25:28.465080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:25:33.640055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:25:48.783633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:27:57.220980Z info ads ADS: "" 4 terminated 2026-11-02T14:28:56.707187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:29:16.529903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:29:21.423577Z info ads ADS: "" 3 terminated 2026-11-02T14:29:37.634568Z info ads ADS: new connection for node:5 2026-11-02T14:29:37.640206Z info cache read certificate from file resource=file-root:system 2026-11-02T14:30:58.815757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:31:00.961232Z info ads ADS: "" 5 terminated 2026-11-02T14:32:35.608081Z info ads ADS: new connection for node:6 2026-11-02T14:32:35.632247Z info cache read certificate from file resource=file-root:system 2026-11-02T14:35:25.382228Z info ads ADS: "" 6 terminated with stream closed 2026-11-02T14:36:56.176302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:36:57.329341Z warn xdsproxy downstream terminated with unexpected error send error for type url type.googleapis.com/envoy.config.route.v3.RouteConfiguration: rpc error: code = Canceled desc = context canceled id=1 2026-11-02T14:36:58.686992Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T14:37:31.982133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:38:51.707609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:43:41.850304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:44:08.054337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:46:19.982421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:46:43.410759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:46:45.703240Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:46:58.198127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:47:02.396616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:47:19.729813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:47:40.127020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:47:50.687770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:48:01.035046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:48:11.507244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:48:21.912044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:48:32.321714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:48:42.692073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:48:53.145188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:49:03.579055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:49:13.985032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:49:24.235297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:50:07.660466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:50:23.542668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:50:25.961462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:50:32.642545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:50:39.502340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:50:49.926530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:51:04.970519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:51:15.944502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:51:17.971842Z info ads ADS: new connection for node:7 2026-11-02T14:51:17.972038Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T14:51:20.018594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:52:00.585975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:52:06.296Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 349 88 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "489482fc-97f6-42ad-b543-3d483dcba41c" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.151:8000" outbound|54321||e2e-prio-pool-170c8925-inference-pool-ip-0b8de156.llm.svc.cluster.local 10.132.0.43:46488 10.132.0.43:443 10.132.0.13:58410 - v1-model-routing 2026-11-02T14:52:20.083856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:52:20.215897Z info ads ADS: "" 7 terminated 2026-11-02T14:52:22.679483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:52:24.314Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 138 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "b0034d44-7aa4-4060-a616-9a1ce151cfd2" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:43344 10.132.0.43:443 10.132.0.13:44626 - v1-completions-path 2026-11-02T14:52:25.708290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:52:31.415958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:52:38.131612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:38.131647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:38.131662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:38.131668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:52:38.049Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 82 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f63cb8c1-7398-409b-a9af-a09be3a3edb5" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:51858 10.132.0.43:443 10.132.0.13:58404 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:52:38.362344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:38.362375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:38.362388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:38.362393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:52:38.308Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 53 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "d5cc2bb0-cd3b-4546-a2ad-4a9ffb23b2c0" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:51858 10.132.0.43:443 10.132.0.13:58416 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:52:43.141885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:53:00.106203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:53:25.828619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:53:26.033626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:53:26.033689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:53:26.033721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:53:26.033732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T14:53:25.957Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 76 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "a88b3e89-bde9-4143-a6e4-76c7160a80d3" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:45716 10.132.0.43:443 10.132.0.13:42490 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:53:40.222529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:53:44.187313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:53:44.187356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:53:44.187388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:53:44.187396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:53:44.586812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:53:44.101Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 86 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f7736696-e9af-42fe-8a10-4ac7fcbb3a13" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:42678 10.132.0.43:443 10.132.0.13:38700 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:53:56.436920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:54:01.061297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:54:16.794508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:56:28.014733Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-02T14:58:57.437222Z info ads ADS: new connection for node:8 2026-11-02T14:58:57.440971Z info cache read certificate from file resource=file-root:system 2026-11-02T14:58:58.590091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:59:00.257469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:59:15.855718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:59:15.855750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:59:15.855763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:59:15.855768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:59:15.855925Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:59:15.744Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 111 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "b07748f5-8a06-4deb-b2ad-37c0b3be5dd8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.43:56636 10.132.0.43:443 10.132.0.13:41136 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:00:05.957975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:00:05.958003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:00:05.958014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:00:05.958018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:00:05.958172Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:00:05.852Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 105 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "0aa2a86f-2344-4980-af03-c881a7c7c611" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.43:59838 10.132.0.43:443 10.132.0.13:50134 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:00:46.537520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:00:46.711315Z info ads ADS: "" 8 terminated with stream closed 2026-11-02T15:00:48.119595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:00:49.713544Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:00:49.713633Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:00:49.713663Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:00:49.713689Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T15:00:49.656Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 57 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "fad5e6af-07da-4fb0-b25b-3a0bf59302c2" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.13:38894 - v1-completions-path 2026-11-02T15:00:54.991941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:00:58.079Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 73 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c8a6c010-1c02-484a-af4c-738a3b687eb8" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59350 10.132.0.43:443 10.132.0.13:36320 - v1-completions-path [2026-11-02T15:00:58.450Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "7be02d77-846f-4559-bf1d-1ea446495f9f" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59366 10.132.0.43:443 10.132.0.13:36328 - v1-completions-path 2026-11-02T15:01:10.717824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:26.924141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:31.924409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:01:31.924445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:01:31.924459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:01:31.924464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:01:31.851Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 73 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "6ef90787-8d2b-46e1-8fa5-430d166c94ed" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:58702 10.132.0.43:443 10.132.0.13:46430 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:01:32.965Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "1260d5d6-9d29-4c3b-b207-87a5ceca335b" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.13:46438 - v1-completions-path 2026-11-02T15:01:50.424807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:00.735960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:05.539795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:02:09.475Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f416cfd9-7894-459c-8579-6d32bb87ffb6" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59366 10.132.0.43:443 10.132.0.13:40476 - v1-completions-path [2026-11-02T15:02:09.650Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "517c0ce8-708d-4e08-a342-2c5ad6ed20fe" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59366 10.132.0.43:443 10.132.0.13:40486 - v1-completions-path [2026-11-02T15:02:10.466Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "0d843b25-317d-4fd9-90ee-2d34b31885a4" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59350 10.132.0.43:443 10.132.0.13:40500 - v1-completions-path 2026-11-02T15:02:22.603598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:24.963044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:32.625323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:44.692421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:50.273798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:58.305562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:03:03.949124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:03:09.949Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 65 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "81fcaeae-dd00-419b-94e2-fb857da15219" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:57010 10.132.0.43:443 10.132.0.13:36200 - v1-completions-path 2026-11-02T15:03:21.965393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:03:25.188353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:03:54.142321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:03:54.142356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:03:54.142370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:03:54.142375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:03:54.065Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 77 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "ffa38ec0-5a73-4b4b-be3a-09a2d4531079" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:54834 10.132.0.43:443 10.132.0.13:34996 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:04:01.373913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:04:19.613374Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:04:29.864642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:07:17.801262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:07:20.439810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:07:20.439846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:07:20.439861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:07:20.439866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:07:20.238Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 201 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f1aa4f89-d0ea-4a8a-be0c-865e4472244b" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:52940 10.132.0.43:443 10.132.0.13:38232 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:07:24.928324Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T15:07:32.816724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:07:45.289554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:07:48.682174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:07:53.106682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:07:53.106718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:07:53.106734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:07:53.106739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:07:53.029Z] "DELETE /v1/api-keys/75fec838-29fa-4251-a4c5-cb83fb53b724 HTTP/1.1" 200 - via_upstream - "-" 0 369 77 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "54d86374-96ef-4a58-9b04-8367f34ef991" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.200:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:35796 10.132.0.43:443 10.132.0.13:40406 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:08:04.921210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:08:15.284408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:08:30.134127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:08:34.166Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 66 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "2dfed604-c79f-4119-942a-de07bee6d1c7" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59350 10.132.0.43:443 10.132.0.13:39208 - v1-completions-path 2026-11-02T15:08:47.501541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:08:52.137978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:08:55.521215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:09:01.497614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:01.497650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:01.497667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:01.497672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:09:01.415Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 82 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "6df597bd-285b-4c96-96f0-e260a443e1c7" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.174:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:55320 10.132.0.43:443 10.132.0.13:34928 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:09:02.521Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "4ba38e8a-f175-967c-bafa-9a92af60b5ed" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.13:34938 - v1-completions-path [2026-11-02T15:09:03.523Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "b4114623-a367-419c-90ad-b8787c521701" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59350 10.132.0.43:443 10.132.0.13:34956 - v1-completions-path [2026-11-02T15:09:05.152Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "4c77fae6-7d9d-492e-8724-93092f6e53d4" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59350 10.132.0.43:443 10.132.0.13:49608 - v1-completions-path 2026-11-02T15:09:06.302029Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:09:06.302069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:09:06.302090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:09:06.302097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:09:06.230Z] "DELETE /v1/api-keys/8307e16c-6c87-4510-bb9b-12937b05aac9 HTTP/1.1" 200 - via_upstream - "-" 0 365 71 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f1714b0b-7398-4eaa-bd10-66f0ab45f8c3" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.132.0.174:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:46194 10.132.0.43:443 10.132.0.13:49620 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:09:18.257840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:09:28.629857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:09:33.254224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:09:45.666222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:09:50.168654Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:09:54.896Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "7da47dfa-7c98-4377-9df8-0365548e653f" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59366 10.132.0.43:443 10.132.0.13:59096 - v1-completions-path [2026-11-02T15:09:55.078Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 55 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "536944b7-e35b-4b91-adeb-6bad5ef62ebc" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59350 10.132.0.43:443 10.132.0.13:59104 - v1-completions-path [2026-11-02T15:09:56.223Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "1e9aa186-49ef-4294-b3b0-808977c662eb" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:59350 10.132.0.43:443 10.132.0.13:59110 - v1-completions-path 2026-11-02T15:10:08.569251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:18.997113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:35.980478Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:10:35.980504Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:10:35.980507Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:10:35.980511Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T15:10:35.785Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 79 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "e58ad7a8-1120-42c3-9c98-58ce1ef29d00" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:57010 10.132.0.43:443 10.132.0.13:49966 - v1-completions-path [2026-11-02T15:10:35.955Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 24 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f0e19c18-fa0c-4a3c-86b2-649b16b77923" "maas.apps.ca30a64395dcfc3deb10.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.13:49972 - v1-completions-path