2026-11-03T13:17:27.910757Z info FLAG: --concurrency="0" 2026-11-03T13:17:27.910785Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T13:17:27.910790Z info FLAG: --help="false" 2026-11-03T13:17:27.910792Z info FLAG: --log_as_json="false" 2026-11-03T13:17:27.910794Z info FLAG: --log_caller="" 2026-11-03T13:17:27.910796Z info FLAG: --log_output_level="default:info" 2026-11-03T13:17:27.910798Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T13:17:27.910803Z info FLAG: --log_target="[stdout]" 2026-11-03T13:17:27.910805Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T13:17:27.910807Z info FLAG: --outlierLogPath="" 2026-11-03T13:17:27.910809Z info FLAG: --profiling="true" 2026-11-03T13:17:27.910811Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T13:17:27.910813Z info FLAG: --proxyLogLevel="warning" 2026-11-03T13:17:27.910815Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T13:17:27.910817Z info FLAG: --stsPort="0" 2026-11-03T13:17:27.910819Z info FLAG: --templateFile="" 2026-11-03T13:17:27.910821Z info FLAG: --tokenManagerPlugin="" 2026-11-03T13:17:27.910824Z info FLAG: --vklog="0" 2026-11-03T13:17:27.910826Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T13:17:27.911018Z info Proxy role ips=[10.133.0.53] type=router id=maas-default-gateway-openshift-default-84587756dc-sl776.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T13:17:27.911070Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T13:17:27.912314Z info cpu limit detected as 2, setting concurrency 2026-11-03T13:17:27.912579Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T13:17:27.912590Z info JWT policy is third-party-jwt 2026-11-03T13:17:27.912593Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T13:17:27.915759Z info Starting default Istio SDS Server 2026-11-03T13:17:27.915791Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T13:17:27.915823Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T13:17:27.916118Z info Opening status port 15020 2026-11-03T13:17:27.917313Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T13:17:27.918816Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T13:17:27.919711Z info Starting proxy agent 2026-11-03T13:17:27.919744Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T13:17:27.920232Z info sds Starting SDS grpc server 2026-11-03T13:17:27.920256Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T13:17:27.982666Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T13:17:28.069475Z info cache generated new workload certificate resourceName=default latency=152.557908ms ttl=23h59m59.930529806s 2026-11-03T13:17:28.069516Z info cache Root cert has changed, start rotating root cert 2026-11-03T13:17:28.069552Z info cache returned workload trust anchor from cache ttl=23h59m59.930448887s 2026-11-03T13:17:28.126320Z info ads ADS: new connection for node:1 2026-11-03T13:17:28.126452Z info cache returned workload certificate from cache ttl=23h59m59.873551638s 2026-11-03T13:17:28.127153Z info ads ADS: new connection for node:2 2026-11-03T13:17:28.127242Z info cache returned workload trust anchor from cache ttl=23h59m59.872759838s 2026-11-03T13:17:28.209470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:17:36.081621Z info Readiness succeeded in 8.173290435s 2026-11-03T13:17:36.082009Z info Envoy proxy is ready 2026-11-03T13:17:44.554683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:17:56.003887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:17:56.003936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:17:56.003959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:17:56.003967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T13:17:55.858Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 145 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "032cee34-d524-4067-a54e-0b74893e0fc5" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:42470 10.133.0.53:443 10.132.0.13:35198 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:18:16.527115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:18:16.527154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:18:16.527172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:18:16.527178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T13:18:16.435Z] "DELETE /v1/api-keys/796dd44f-5d86-44dd-9f36-6e5b1d000f01 HTTP/1.1" 200 - via_upstream - "-" 0 321 91 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c99dc0ab-dcc9-4c0f-8023-f4e8febf6df6" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:42470 10.133.0.53:443 10.132.0.13:37860 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T13:18:17.024Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 46 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "26450fcc-c30c-416d-b4ca-b5919212b6fb" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.53:443 10.132.0.13:37872 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:18:17.785000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:18:17.785035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:18:17.785057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:18:17.785062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T13:18:17.697Z] "DELETE /v1/api-keys/fdaf0f6e-8e42-4eab-9765-182f94bc9945 HTTP/1.1" 200 - via_upstream - "-" 0 321 87 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "5b974962-d5a4-42c2-8506-cb150e14d9d4" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:42470 10.133.0.53:443 10.132.0.13:37884 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:18:19.370559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:18:19.370593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:18:19.370606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:18:19.370611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T13:18:19.307Z] "DELETE /v1/api-keys/1259cdb8-9872-4512-a7d1-b1753717d081 HTTP/1.1" 200 - via_upstream - "-" 0 321 63 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "9ba73e19-55c8-4520-ae88-4caed3b6cf17" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:42470 10.133.0.53:443 10.132.0.13:37896 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:18:37.022926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:18:40.239559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T13:18:57.849Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 13 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "8a3963de-84f2-494d-a114-5d0328e851d3" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.53:443 10.132.0.13:52642 - - [2026-11-03T13:20:27.137Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 334 145 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "435bdc06-3436-4a1f-86cb-8e5d933cf86c" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:51140 10.133.0.53:443 10.132.0.13:59758 - v1-chat-completions-path [2026-11-03T13:20:35.101Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 14 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "6192834c-0e48-4c38-8b7c-4a44724610d4" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.53:443 10.132.0.13:39894 - - 2026-11-03T13:21:43.725963Z info ads ADS: new connection for node:3 2026-11-03T13:21:43.734876Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T13:21:43.735027Z info cache read certificate from file resource=file-root:system 2026-11-03T13:28:56.464548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:29:08.423783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:29:28.149603Z info ads ADS: new connection for node:4 2026-11-03T13:29:28.149828Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T13:29:28.149879Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T13:29:56.538185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:30:36.341677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:31:04.472294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:31:31.845248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:31:36.455790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:36.455835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:36.455855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:36.455863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:31:36.584523Z info ads ADS: "" 4 terminated [2026-11-03T13:31:34.709Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 1746 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "68429ac7-3d2e-43f5-85df-49bfae53759e" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:39844 10.133.0.53:443 10.132.0.13:35706 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:31:37.929671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:37.929707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:37.929722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:37.929728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:31:37.929919Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-03T13:31:38.062827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-03T13:31:38.131001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:38.131041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:38.131057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:38.131063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:31:38.131310Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T13:31:37.481Z] "POST /anything/e2e-rt-sw-2ece70-client HTTP/1.1" 200 - via_upstream - "-" 124 1767 448 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c2c94e58-bfc8-4b53-ab9a-1ff172c409da" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:52064 10.133.0.53:443 10.132.0.13:52840 - llm.external-model-e2e-rt-sw-2ece70-8a582f45b424.0 [2026-11-03T13:31:37.991Z] "POST /anything/e2e-rt-sw-2ece70-client HTTP/1.1" 200 - via_upstream - "-" 124 1767 139 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "fb3516e7-84bc-428b-a8f1-d1501bfcb6b5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:52076 10.133.0.53:443 10.132.0.13:52856 - llm.external-model-e2e-rt-sw-2ece70-8a582f45b424.0 2026-11-03T13:31:43.770061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:43.770094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:43.770105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:31:43.770109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:43.770260Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T13:31:43.704Z] "POST /llm/e2e-rt-sw-2ece70/anything/e2e-rt-sw-2ece70-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 65 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "ebed7d2b-ba6f-4f85-9036-a2d1e900e4da" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-2ece70.llm.svc.cluster.local - 10.133.0.53:443 10.132.0.13:52864 - llm.external-model-e2e-rt-sw-2ece70-8a582f45b424.2 [2026-11-03T13:31:54.140Z] "POST /llm/e2e-rt-sw-2ece70/anything/e2e-rt-sw-2ece70-client HTTP/1.1" 404 - - "-" 124 0 63 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "09665389-b999-4b50-8c6d-ec37c67968ce" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-2ece70.llm.svc.cluster.local - 10.133.0.53:443 10.132.0.13:35438 - llm.external-model-e2e-rt-sw-2ece70-8a582f45b424.2 2026-11-03T13:31:55.430737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:31:59.778972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:59.779012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:59.779028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:31:59.779035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:31:59.779322Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T13:31:59.280Z] "POST /anything/e2e-rt-sw-2ece70-client HTTP/1.1" 200 - via_upstream - "-" 124 1758 499 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "2e030cef-f1f3-4b41-a9c6-89074c846e02" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:56436 10.133.0.53:443 10.132.0.13:38040 - llm.external-model-e2e-rt-sw-2ece70-8a582f45b424.0 2026-11-03T13:32:07.363324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T13:32:07.365565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:32:07.365588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:32:07.365599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:32:07.365604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:32:07.365754Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T13:32:07.298Z] "POST /llm/e2e-rt-sw-2ece70/anything/e2e-rt-sw-2ece70-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 67 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "35a3ad91-48ef-4a6e-9ffb-0494100a6de3" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-2ece70.llm.svc.cluster.local - 10.133.0.53:443 10.132.0.13:38652 - llm.external-model-e2e-rt-sw-2ece70-8a582f45b424.2 2026-11-03T13:32:12.160803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:32:36.784586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:33:02.871522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:34:41.881891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:34:47.891179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:47.891214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:47.891225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:47.891230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:34:47.891453Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-11-03T13:34:48.262814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:48.262848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:48.262860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:34:48.262865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:48.263037Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T13:34:47.678Z] "POST /anything/e2e-rt-eq-86abdb-client HTTP/1.1" 200 - via_upstream - "-" 124 1765 213 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "ed756f94-f00e-4e58-a33c-2a844738a72a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:44262 10.133.0.53:443 10.132.0.13:33570 - llm.external-model-e2e-rt-eq-86abdb-c702f89b7e8b.2 [2026-11-03T13:34:48.158Z] "POST /anything/e2e-rt-eq-86abdb-client HTTP/1.1" 200 - via_upstream - "-" 124 1767 104 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "d7ad5460-981b-4f40-a4a7-41ad51a7daa3" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:44262 10.133.0.53:443 10.132.0.13:33582 - llm.external-model-e2e-rt-eq-86abdb-c702f89b7e8b.0 2026-11-03T13:34:49.367188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:49.367224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:49.367236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:34:49.367241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:49.367472Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T13:34:49.268Z] "POST /anything/e2e-rt-eq-86abdb-client HTTP/1.1" 200 - via_upstream - "-" 124 1760 99 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "3bfc97fa-4f68-4e8d-a543-4fcbc19c680e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:44262 10.133.0.53:443 10.132.0.13:33594 - llm.external-model-e2e-rt-eq-86abdb-c702f89b7e8b.2 2026-11-03T13:34:49.865050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:34:49.865099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:34:49.865114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:34:49.865120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:34:49.865409Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T13:34:49.691Z] "POST /anything/e2e-rt-eq-86abdb-client HTTP/1.1" 200 - via_upstream - "-" 124 1767 173 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "ff5f953e-8f87-4fce-9efa-2cb53a311ade" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:44268 10.133.0.53:443 10.132.0.13:33610 - llm.external-model-e2e-rt-eq-86abdb-c702f89b7e8b.0 2026-11-03T13:34:50.656552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:50.656585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:50.656597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:34:50.656601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:34:50.656775Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T13:34:50.545Z] "POST /anything/e2e-rt-eq-86abdb-client HTTP/1.1" 200 - via_upstream - "-" 124 1768 110 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "d15a07e3-aed9-4311-a920-3799fecb640d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:44262 10.133.0.53:443 10.132.0.13:33616 - llm.external-model-e2e-rt-eq-86abdb-c702f89b7e8b.2 2026-11-03T13:35:14.939603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:35:31.503159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:35:53.340191Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T13:36:34.586110Z info ads ADS: new connection for node:5 2026-11-03T13:36:34.598668Z info cache read certificate from file resource=file-root:system 2026-11-03T13:37:18.761780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:38:08.183396Z info ads ADS: "" 5 terminated 2026-11-03T13:39:04.794941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:42:23.347204Z info ads ADS: new connection for node:6 2026-11-03T13:42:23.371717Z info cache read certificate from file resource=file-root:system 2026-11-03T13:44:21.148018Z info ads ADS: "" 6 terminated 2026-11-03T13:46:09.471451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:46:20.353516Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T13:46:33.900174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:48:35.694102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:48:50.965101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:48:52.648675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:49:02.563529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:49:05.922987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:49:09.412467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:49:24.703608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:49:44.644888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:49:54.888205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:50:05.193830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:50:15.531422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:50:25.654704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:50:35.881250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:50:46.090549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:50:56.282446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:51:06.430162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:51:16.702093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:51:54.138823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:52:09.612562Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T13:52:09.612585Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T13:52:09.612588Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T13:52:09.612592Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 2026-11-03T13:52:10.037198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T13:52:09.559Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 53 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "d4a483e4-e0a0-4902-9ad2-439fecf9c014" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.53:443 10.132.0.13:48996 - v1-catch-all-path 2026-11-03T13:52:11.738680Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:52:17.534420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:52:20.833458Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-03T13:52:20.732Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 101 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "90e8eeeb-8da3-4aff-a3fb-ebe953e0102c" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:60968 10.133.0.53:443 10.132.0.13:46390 - v1-catch-all-path 2026-11-03T13:52:21.293704Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-03T13:52:21.228Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 65 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "9962f79c-2dcf-4e11-ae5c-fe7a55e5a970" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:60968 10.133.0.53:443 10.132.0.13:46392 - v1-catch-all-path 2026-11-03T13:52:33.063409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:52:34.634217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:52:49.205000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:52:59.961260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:53:01.553019Z info ads ADS: new connection for node:7 2026-11-03T13:53:01.553242Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T13:53:02.895884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:53:43.814078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T13:53:49.239Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 333 89 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "bb4158d1-20ba-4bb4-87e7-04c194e370f5" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.199:8000" outbound|54321||e2e-prio-pool-d2dab122-inference-pool-ip-05c05bdc.llm.svc.cluster.local 10.133.0.53:60944 10.133.0.53:443 10.132.0.13:33184 - v1-model-routing [2026-11-03T13:53:49.672Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 328 63 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "fb4ad6d8-981a-44be-93b4-e5bdba485fee" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.199:8000" outbound|54321||e2e-prio-pool-d2dab122-inference-pool-ip-05c05bdc.llm.svc.cluster.local 10.133.0.53:60956 10.133.0.53:443 10.132.0.13:33196 - v1-model-routing 2026-11-03T13:54:02.810059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:54:03.313157Z info ads ADS: "" 7 terminated with stream closed 2026-11-03T13:54:04.615824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:54:07.702199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:54:11.675138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:54:23.796935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:54:40.464390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:54:55.355669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:54:55.355705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:54:55.355719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:54:55.355724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:54:55.467213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:54:55.467248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:54:55.467267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:54:55.467272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T13:54:55.281Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 74 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "ba45d05c-9d5b-4f44-b3b9-b948fcf15236" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:48468 10.133.0.53:443 10.132.0.13:60354 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T13:54:55.411Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 55 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "ca253f24-b033-4dc6-a770-c73855feb78e" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:48478 10.133.0.53:443 10.132.0.13:60356 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:54:56.757152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:55:08.381482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:55:08.886479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:55:08.886516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:55:08.886535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:55:08.886542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T13:55:08.778Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 107 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "8b8b3b79-7eec-4792-a748-8f5eecf5f06e" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:48478 10.133.0.53:443 10.132.0.13:35980 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:55:12.201203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:55:20.376962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:55:22.942791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T13:55:26.792Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 62 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "df373d3d-7a2c-42a1-aa4b-0590582066c8" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.53:443 10.132.0.13:46144 - v1-completions-path 2026-11-03T13:55:38.589858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:59:40.797004Z info ads ADS: new connection for node:8 2026-11-03T13:59:40.800704Z info cache read certificate from file resource=file-root:system 2026-11-03T13:59:41.478204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:59:42.909849Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T13:59:57.072945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:59:57.072989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:59:57.073005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:59:57.073010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:59:57.073208Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T13:59:56.941Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 132 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f3747df5-a7da-4b68-88ca-1bc99c080f33" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:52514 10.133.0.53:443 10.132.0.13:53364 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T14:00:53.682225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:53.682258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:53.682268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T14:00:53.682272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:53.682460Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T14:00:53.580Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 101 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "1b6c9e79-10c0-4720-8863-b096766164ad" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:52514 10.133.0.53:443 10.132.0.13:46338 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T14:00:55.863400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T14:00:55.863431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T14:00:55.863443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T14:00:55.863448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T14:00:55.863611Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T14:00:55.740Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 123 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "a915fee2-bda9-4df5-8bd0-435c27571bb0" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:41034 10.133.0.53:443 10.132.0.13:50736 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T14:01:11.088766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T14:01:11.088796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T14:01:11.088806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T14:01:11.088810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T14:01:11.088951Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T14:01:10.988Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 100 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "5d0902ca-7d37-4081-a2d6-17a68fa40377" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.53:41034 10.133.0.53:443 10.132.0.13:53386 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T14:01:26.680135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:01:26.791411Z info ads ADS: "" 8 terminated 2026-11-03T14:01:28.375270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:01:31.428077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:01:43.440211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:01:45.284079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:01:47.923688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:01:56.630533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T14:02:03.147Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "036aa0e8-b47c-4cf5-9a2b-1e4c89a902cd" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34466 10.133.0.53:443 10.132.0.13:40630 - v1-completions-path [2026-11-03T14:02:04.681Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "aa0d2053-d97a-4f88-97ee-4a54611f2e8a" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34466 10.133.0.53:443 10.132.0.13:51618 - v1-completions-path [2026-11-03T14:02:05.126Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c32b92d1-bd46-43c4-9c98-ee2e551aa6fe" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34466 10.133.0.53:443 10.132.0.13:51634 - v1-completions-path [2026-11-03T14:02:05.353Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "0edbfe8a-1500-4181-a354-21f2db4e80a6" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:51642 - v1-completions-path 2026-11-03T14:02:21.383174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:02:31.626998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:02:33.313437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T14:02:39.397Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "212b388f-4a3a-46f3-ab3d-d25cecc65f54" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:35368 - v1-completions-path [2026-11-03T14:02:39.742Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 55 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "8eb2aa90-4f8c-427d-881c-c7b4dc7bc30b" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:35376 - v1-completions-path [2026-11-03T14:02:40.076Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "1fc16024-a17e-4727-837a-1a24e8618d3d" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34466 10.133.0.53:443 10.132.0.13:35386 - v1-completions-path [2026-11-03T14:02:40.549Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f8d4ef8d-033d-4217-be0b-79ad31e448bc" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:35388 - v1-completions-path 2026-11-03T14:02:52.302475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:02:54.018555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:02:59.872133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:03:10.791541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:03:24.449461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:03:26.057623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:03:31.712356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:03:49.815257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:03:52.455222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T14:04:03.666Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "62cf1ce8-fc80-4aff-bbb1-a5d197a1dbbf" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.53:443 10.132.0.13:54804 - v1-completions-path 2026-11-03T14:04:05.204532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:04:07.339823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:04:11.815883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:04:18.232918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:04:18.232956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:04:18.232972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:04:18.232978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T14:04:18.168Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 64 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "c151e305-c2f9-426c-a4f5-50abb6f21ee7" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.133.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:46638 10.133.0.53:443 10.132.0.13:33414 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:04:30.157406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:04:40.404956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:04:56.881270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:04:59.829781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:06:05.426712Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T14:07:14.444699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:07:17.476171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:07:19.679708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:07:34.832519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:07:45.029210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:08:04.977948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:11:40.707783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:11:45.105830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:12:01.287881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:12:11.423463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:12:14.750267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T14:12:20.579Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "55e9d1c3-13cc-441b-ac85-e8c14ec3ef80" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:53800 - v1-completions-path [2026-11-03T14:12:21.014Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 56 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "892a5133-8d93-4369-830a-1c504acd5510" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34466 10.133.0.53:443 10.132.0.13:53814 - v1-completions-path 2026-11-03T14:12:21.871473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T14:12:21.871508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T14:12:21.871523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T14:12:21.871528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T14:12:21.805Z] "DELETE /v1/api-keys/70395fcf-c9f6-4a59-8056-093fcb2f6492 HTTP/1.1" 200 - via_upstream - "-" 0 365 66 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "cd3e1331-9557-4088-a631-26a4f7855769" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.245:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.53:57206 10.133.0.53:443 10.132.0.13:53818 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:12:33.403688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:12:35.543802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:12:38.823067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T14:12:42.444Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 64 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "4ecb88eb-ff31-4c30-8dee-e9bc349de9a0" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:36270 - v1-completions-path [2026-11-03T14:12:45.791Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 135 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "29f3827d-2ed6-405f-98f6-ca4a3240248a" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:47312 - v1-completions-path [2026-11-03T14:12:46.310Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f10cd50c-166e-96ba-9976-c7ab3b3ea86c" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:47322 - v1-completions-path [2026-11-03T14:12:47.609Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "a311787d-dab5-4d7c-abb4-ea114aaae5a4" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:34478 10.133.0.53:443 10.132.0.13:47338 - v1-completions-path 2026-11-03T14:12:59.611298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:13:09.897407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:13:12.075133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:13:15.450570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:13:23.534883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:13:42.223541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T14:13:52.400306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T14:13:53.058Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 74 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "2b0ca141-3575-4e3a-ac5d-36a9766cfae3" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:35196 10.133.0.53:443 10.132.0.13:59966 - v1-completions-path [2026-11-03T14:13:57.650Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 66 - "34.228.250.194,10.132.0.13" "python-requests/2.33.0" "f5ca0ed6-24ae-4ae4-a45f-23c6b67974de" "maas.apps.013b5c78a9b24bb4ebb6.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.53:35196 10.133.0.53:443 10.132.0.13:37748 - v1-completions-path