envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T22:56:20.696483Z info JWT policy is third-party-jwt 2026-11-02T22:56:20.696485Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T22:56:20.698202Z info Starting default Istio SDS Server 2026-11-02T22:56:20.698219Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T22:56:20.698242Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T22:56:20.698536Z info Opening status port 15020 2026-11-02T22:56:20.699316Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T22:56:20.700281Z info sds Starting SDS grpc server 2026-11-02T22:56:20.700297Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T22:56:20.700698Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T22:56:20.701480Z info Starting proxy agent 2026-11-02T22:56:20.701510Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T22:56:20.792799Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T22:56:20.864764Z info cache generated new workload certificate resourceName=default latency=164.335424ms ttl=23h59m59.135253667s 2026-11-02T22:56:20.864824Z info cache Root cert has changed, start rotating root cert 2026-11-02T22:56:20.864873Z info cache returned workload trust anchor from cache ttl=23h59m59.135134857s 2026-11-02T22:56:20.929927Z info ads ADS: new connection for node:1 2026-11-02T22:56:20.929991Z info cache returned workload certificate from cache ttl=23h59m59.070010514s 2026-11-02T22:56:20.930707Z info ads ADS: new connection for node:2 2026-11-02T22:56:20.930784Z info cache returned workload trust anchor from cache ttl=23h59m59.069217597s 2026-11-02T22:56:20.973651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:56:26.806295Z info Readiness succeeded in 6.11369617s 2026-11-02T22:56:26.806621Z info Envoy proxy is ready 2026-11-02T22:58:10.724110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:58:28.453041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:58:43.711687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:58:52.347942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:58:56.670706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:59:03.828484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:59:11.319664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:59:18.025898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:59:50.352937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:59:50.352984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:59:50.353005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:59:50.353012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T22:59:50.259Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 93 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "cf86d425-2d3c-45f3-9db5-ba8b450cd3cb" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:51192 10.132.0.36:443 10.132.0.17:49028 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T22:59:51.822Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 60 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "c8a3afab-c111-442f-a9a4-6622f3d316fa" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:49034 - v1-model-routing 2026-11-02T22:59:53.694408Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T22:59:53.694433Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T22:59:53.694437Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T22:59:53.694442Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 2026-11-02T22:59:54.052071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:59:54.052113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:59:54.052152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:59:54.052160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T22:59:53.677Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 17 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "c8a197b1-2da1-46c2-a59a-998eef70d449" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:49046 - v1-model-routing [2026-11-02T22:59:53.892Z] "DELETE /v1/api-keys/3f9844de-025d-4bdb-9939-5a3b7f6b5fd5 HTTP/1.1" 200 - via_upstream - "-" 0 365 159 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "3d8a181e-4c63-456f-931f-4f79b8b088f9" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:51204 10.132.0.36:443 10.132.0.17:49056 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:59:54.928874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:59:54.928916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:59:54.928937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:59:54.928945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T22:59:54.822Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 106 - "44.212.242.249,10.132.0.17" "curl/7.76.1" "7e12173e-e366-4699-a56f-b08a5a06357f" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:51192 10.132.0.36:443 10.132.0.17:49070 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T23:05:27.540910Z info ads ADS: new connection for node:3 2026-11-02T23:05:27.546331Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T23:05:27.546433Z info cache read certificate from file resource=file-root:system 2026-11-02T23:05:32.315113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:05:33.230818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:05:55.398009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:05:57.516622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:05:57.516658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:05:57.516673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:05:57.516678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:05:57.875325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:05:57.875364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:05:57.875377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:05:57.875384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:05:57.875632Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T23:05:57.386Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 130 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "fe4c1be7-6e90-4549-99cf-f3d63a48899b" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:42952 10.132.0.36:443 10.132.0.17:57232 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T23:05:57.714Z] "POST /anything/e2e-rt-sw-0649a6-client HTTP/1.1" 200 - via_upstream - "-" 124 1764 161 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f5d81f99-daf9-4e1a-8499-4b236116e0c5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:55724 10.132.0.36:443 10.132.0.17:57248 - llm.external-model-e2e-rt-sw-0649a6-a59d2f9278d2.2 [2026-11-02T23:06:05.072Z] "POST /llm/e2e-rt-sw-0649a6/anything/e2e-rt-sw-0649a6-client HTTP/1.1" 404 - - "-" 124 0 23 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "b90c8855-2f3a-4aa6-a714-b6ee25b4ae0a" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-0649a6.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:56330 - llm.external-model-e2e-rt-sw-0649a6-a59d2f9278d2.2 2026-11-02T23:06:05.892671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:06:10.373901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T23:06:10.380213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:06:10.380244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:06:10.380261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:06:10.380267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:06:10.380439Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T23:06:10.299Z] "POST /llm/e2e-rt-sw-0649a6/anything/e2e-rt-sw-0649a6-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 80 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "bcfac091-4c43-4b43-a5bd-adcebcdffb31" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-0649a6.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:46344 - llm.external-model-e2e-rt-sw-0649a6-a59d2f9278d2.2 2026-11-02T23:06:37.871744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:06:37.871783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:06:37.871796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:06:37.871802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:06:37.872040Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T23:06:37.748Z] "POST /anything/e2e-rt-sw-0649a6-client HTTP/1.1" 200 - via_upstream - "-" 124 1766 123 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "88b2515a-a871-449f-bed9-028f8196950d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59940 10.132.0.36:443 10.132.0.17:56912 - llm.external-model-e2e-rt-sw-0649a6-a59d2f9278d2.0 2026-11-02T23:07:03.071994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:07:03.072025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:07:03.072033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:07:03.072038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:07:03.072212Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T23:07:02.950Z] "POST /anything/e2e-rt-sw-0649a6-client HTTP/1.1" 200 - via_upstream - "-" 124 1764 121 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a0c99562-045c-4a55-9e66-bcee00dcf04e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:58650 10.132.0.36:443 10.132.0.17:39746 - llm.external-model-e2e-rt-sw-0649a6-a59d2f9278d2.0 2026-11-02T23:07:11.581631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:07:25.146190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T23:07:25.208771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:07:25.208804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:07:25.208815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:07:25.208819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:07:25.208961Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T23:07:25.133Z] "POST /llm/e2e-rt-sw-0649a6/anything/e2e-rt-sw-0649a6-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 75 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "db7bf166-e279-4aa9-9412-c3d356d041bc" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-0649a6.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:39498 - llm.external-model-e2e-rt-sw-0649a6-a59d2f9278d2.2 2026-11-02T23:08:05.790833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:08:05.790864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:08:05.790950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:08:05.790959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:08:05.791161Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T23:08:02.638Z] "POST /anything/e2e-rt-sw-0649a6-client HTTP/1.1" 200 - via_upstream - "-" 124 1759 3152 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "57c0924f-10cd-45c3-ac99-7043e1d0ed6e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:39616 10.132.0.36:443 10.132.0.17:34698 - llm.external-model-e2e-rt-sw-0649a6-a59d2f9278d2.0 2026-11-02T23:08:25.459966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:08:40.895743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T23:09:16.797Z] "POST /llm/e2e-rt-eq-249ffd/anything/e2e-rt-eq-249ffd-client HTTP/1.1" 503 - - "-" 124 0 68 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "4c0885c1-90f1-4d96-80ba-d931a65c3e25" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-249ffd.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:41058 - llm.external-model-e2e-rt-eq-249ffd-b4cdc3d29c1d.4 [2026-11-02T23:09:38.448Z] "POST /llm/e2e-rt-eq-249ffd/anything/e2e-rt-eq-249ffd-client HTTP/1.1" 503 - - "-" 124 0 106 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "42253ce0-1168-4ca7-9d5d-38380cbd70e1" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-249ffd.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:44262 - llm.external-model-e2e-rt-eq-249ffd-b4cdc3d29c1d.4 [2026-11-02T23:10:27.640Z] "POST /llm/e2e-rt-eq-249ffd/anything/e2e-rt-eq-249ffd-client HTTP/1.1" 503 - - "-" 124 0 79 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "7d049863-1fb3-47fd-913f-fd6829a30921" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-249ffd.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:52906 - llm.external-model-e2e-rt-eq-249ffd-b4cdc3d29c1d.4 [2026-11-02T23:10:54.675Z] "POST /llm/e2e-rt-eq-249ffd/anything/e2e-rt-eq-249ffd-client HTTP/1.1" 503 - - "-" 124 0 988 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "2d04372e-36f5-44a8-9386-6786d1b1791d" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-249ffd.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:54416 - llm.external-model-e2e-rt-eq-249ffd-b4cdc3d29c1d.4 [2026-11-02T23:11:06.294Z] "POST /llm/e2e-rt-eq-249ffd/anything/e2e-rt-eq-249ffd-client HTTP/1.1" 503 - - "-" 124 0 76 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "b2d9f230-7e89-44ec-8088-46bcb5ddf5f6" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-249ffd.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:59220 - llm.external-model-e2e-rt-eq-249ffd-b4cdc3d29c1d.4 2026-11-02T23:11:13.623955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:11:43.722351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:12:38.539113Z info ads ADS: "" 3 terminated 2026-11-02T23:12:39.451748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:13:01.545348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:13:24.590193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:15:41.967631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:41.967670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:41.967685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:15:41.967690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T23:15:41.792Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 175 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1155fb6e-0f5c-42cc-a296-733d39afc513" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:45336 10.132.0.36:443 10.132.0.17:56660 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T23:15:45.731574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:15:45.731612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:15:45.731631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:15:45.731635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:15:46.029637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:46.029682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:46.029703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:15:46.029709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T23:15:45.612Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 118 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "6f93ea85-df8f-4a28-84d9-479ed0ba2f1e" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:45340 10.132.0.36:443 10.132.0.17:56678 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T23:15:45.922Z] "DELETE /v1/api-keys/d950e820-dd1c-420b-b760-3b44231cda2d HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f926c705-635c-4ab5-8cfd-4adaa32bd990" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:45336 10.132.0.36:443 10.132.0.17:56688 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T23:15:46.512811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:46.512849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:46.512864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:46.512869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T23:15:46.402Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 110 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d0a614ae-d85d-4c0e-b082-4cb2ff3f548c" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:45336 10.132.0.36:443 10.132.0.17:56700 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T23:15:47.911451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:15:47.911508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:15:47.911531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:15:47.911543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T23:15:47.787Z] "DELETE /v1/api-keys/05bcccbb-83b2-4715-a7ba-63f3fb11d2ef HTTP/1.1" 200 - via_upstream - "-" 0 321 124 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "ac80168e-d5e9-4d24-8bb4-635317319150" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:45340 10.132.0.36:443 10.132.0.17:56704 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T23:15:50.172098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:50.172223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:15:50.172251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:15:50.172259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T23:15:49.980Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 192 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "b7c26f75-e96e-48e0-a13a-3458e8599a67" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:45336 10.132.0.36:443 10.132.0.17:59822 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T23:16:01.798678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:16:01.798718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:16:01.798741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:16:01.798748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T23:16:01.257Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 220 - "44.212.242.249,10.132.0.17" "-" "44e4e937-693f-4a53-a241-77db9a02d625" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:35008 10.132.0.36:443 10.132.0.17:44826 - v1-completions-path [2026-11-02T23:16:01.684Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 114 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "036852de-a288-45d1-80d5-51b100ceacfd" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:45340 10.132.0.36:443 10.132.0.17:44838 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T23:27:24.622Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 89 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "14a6f918-28ad-4524-905b-5906c4658a53" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32868 10.132.0.36:443 10.132.0.17:60714 - v1-chat-completions-path 2026-11-02T23:27:36.491348Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T23:29:06.823039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:29:06.823076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:29:06.823090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:29:06.823094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T23:29:06.810Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 12 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "128597a0-3bbc-4f94-8349-6df408cb29c5" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:42878 10.132.0.36:443 10.132.0.17:58546 - odh-ai-gateway-infra.maas-api-route.4 2026-11-02T23:29:08.369430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:29:08.369467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:29:08.369480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:29:08.369484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:29:08.369631Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-02T23:29:08.369680Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T23:29:08.369688Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T23:29:08.369691Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T23:29:08.369695Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T23:29:08.307Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 62 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a0bcc18f-2b4e-4f4c-93bc-fa66a167709e" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:35008 10.132.0.36:443 10.132.0.17:58562 - v1-completions-path 2026-11-02T23:41:28.738112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:41:28.738164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:41:28.738179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:41:28.738184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T23:41:28.496Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 242 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "b659ceea-2bf2-4f71-b32f-5629f774b825" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:36202 10.132.0.36:443 10.132.0.17:49096 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T23:41:28.946Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 320 79 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d2445d34-ca7b-4c3c-961a-dd2ecf5f6cfd" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:35008 10.132.0.36:443 10.132.0.17:51964 - v1-chat-completions-path 2026-11-02T23:41:29.555603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:41:29.555645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:41:29.555664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:41:29.555670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:41:29.555857Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-02T23:41:29.555920Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T23:41:29.555932Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T23:41:29.555936Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T23:41:29.555940Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T23:41:29.233Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 331 66 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e0d8a151-5636-4422-b28e-25148011af18" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:35008 10.132.0.36:443 10.132.0.17:51966 - v1-chat-completions-path [2026-11-02T23:41:29.491Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 126 129 64 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "9db92835-f929-4268-8b7d-a7260bdee854" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:35008 10.132.0.36:443 10.132.0.17:51978 - v1-chat-completions-path [2026-11-02T23:45:27.838Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 11 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "38f33d6d-1407-4433-8f96-966d911c776e" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.36:443 10.132.0.17:55198 - - 2026-11-02T23:52:51.943424Z info ads ADS: new connection for node:4 2026-11-02T23:52:51.947034Z info cache read certificate from file resource=file-root:system 2026-11-02T23:52:56.779202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:53:26.390887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:53:36.051886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:53:36.051932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:53:36.051955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:53:36.051961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T23:53:35.870Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 181 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a5e65f73-96b4-4af4-ae0d-8e0fca6db18f" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:37700 10.132.0.36:443 10.132.0.17:58384 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T23:53:36.453306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:53:36.453340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:53:36.453351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:53:36.453357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:53:36.453564Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-02T23:53:37.159419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:53:37.159458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:53:37.159468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T23:53:37.159471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T23:53:37.159616Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T23:53:36.306Z] "POST /anything/e2e-dft-d4a253-f174ca HTTP/1.1" 200 - via_upstream - "-" 109 1775 147 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a0bd5f6d-87b8-4da6-bb12-7c5d300a758d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:45986 10.132.0.36:443 10.132.0.17:58394 - llm.external-model-e2e-dft-d4a253-c22d8ae88885.0 [2026-11-02T23:53:37.043Z] "POST /anything/e2e-dft-d4a253-f174ca HTTP/1.1" 200 - via_upstream - "-" 109 1764 116 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f6c03b7b-f129-46f2-8daa-1dd4b2f5cfe1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:45986 10.132.0.36:443 10.132.0.17:58404 - llm.external-model-e2e-dft-d4a253-c22d8ae88885.0 2026-11-02T23:53:37.839385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:53:37.839413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:53:37.839423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T23:53:37.839437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T23:53:37.839604Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T23:53:37.363Z] "POST /llm/e2e-dft-d4a253/anything/e2e-dft-d4a253-f174ca HTTP/1.1" 401 - - "-" 109 88 143 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "67d7a381-37e1-4119-9b1b-266090fff530" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-d4a253.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:58406 - llm.external-model-e2e-dft-d4a253-c22d8ae88885.2 [2026-11-02T23:53:37.721Z] "POST /anything/e2e-dft-d4a253-f174ca HTTP/1.1" 200 - via_upstream - "-" 109 1778 118 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f4e2d153-1a5c-44d1-aee3-d7ad895916d9" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:45992 10.132.0.36:443 10.132.0.17:58416 - llm.external-model-e2e-dft-d4a253-c22d8ae88885.0 2026-11-02T23:53:50.316034Z info ads ADS: "" 4 terminated 2026-11-02T23:53:51.384317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:53:53.273924Z info ads ADS: new connection for node:5 2026-11-02T23:53:53.279163Z info cache read certificate from file resource=file-root:system 2026-11-02T23:53:57.553324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:53:58.847283Z info ads ADS: "" 5 terminated 2026-11-02T23:54:01.343978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:54:05.528085Z info ads ADS: new connection for node:6 2026-11-02T23:54:05.533403Z info cache read certificate from file resource=file-root:system 2026-11-02T23:54:07.927865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:54:11.633179Z info ads ADS: "" 6 terminated 2026-11-02T23:54:12.507946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:54:14.190394Z info ads ADS: new connection for node:7 2026-11-02T23:54:14.196006Z info cache read certificate from file resource=file-root:system 2026-11-02T23:54:20.402749Z info ads ADS: "" 7 terminated with stream closed 2026-11-02T23:54:21.110090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:54:22.321041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:54:30.253112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:54:50.963495Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T23:55:18.473228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:59:02.227569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T23:59:43.630689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:00:12.705635Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:01:15.743465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:19:12.850859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:19:12.850903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:19:12.850919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:19:12.850924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:19:12.674Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 176 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "833df6b9-c5b4-430a-8f5a-b384960d1cec" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:37012 10.132.0.36:443 10.132.0.17:43934 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:19:18.081529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:19:18.419679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:19:18.419721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:19:18.419741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:19:18.419747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:19:18.290Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 128 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "cc8a3db6-e7d3-4d7d-b584-262515f87ec5" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:37026 10.132.0.36:443 10.132.0.17:43944 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:19:43.878606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:20:20.579048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:20:24.495Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 362 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "653fb1bb-49f4-44fe-acff-f924432cd412" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59740 10.132.0.36:443 10.132.0.17:49542 - v1-chat-completions-path [2026-11-03T00:20:26.516Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 67 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f421080a-370e-4839-9bf0-481c89f8a12a" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59752 10.132.0.36:443 10.132.0.17:49552 - v1-chat-completions-path 2026-11-03T00:20:40.358891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:20:45.291447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:20:45.935553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:20:45.935588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:20:45.935603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:20:45.935607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:20:45.768Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 167 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "77088a4f-0213-4ab0-9489-28bca31acc3d" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54934 10.132.0.36:443 10.132.0.17:37666 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T00:20:46.137Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 1373 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a9672571-3bec-4fb8-ba43-32e056ee8d79" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:37672 - v1-catch-all-path 2026-11-03T00:20:54.829997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:08.716893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:18.143188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:28.687067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:46.653663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:48.648418Z info ads ADS: new connection for node:8 2026-11-03T00:21:48.648665Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:21:48.648723Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:21:56.190120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:22:32.578244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:22:38.192Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 349 86 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "632efe80-0819-4cdb-aacc-52a83457f971" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.208:8000" outbound|54321||e2e-prio-pool-37a87c71-inference-pool-ip-ac6ea8b0.llm.svc.cluster.local 10.132.0.36:37978 10.132.0.36:443 10.132.0.17:38836 - v1-model-routing 2026-11-03T00:22:42.614938Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-11-03T00:22:56.546140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:22:56.572243Z info ads ADS: "" 8 terminated with stream closed 2026-11-03T00:23:01.388203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:23:17.870050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:25:57.201160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:26:28.517972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:26:56.712695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:26:56.712731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:26:56.712746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:26:56.712750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:26:56.595Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 117 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a471fc16-911b-4568-9b1f-55a34aae11b6" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54948 10.132.0.36:443 10.132.0.17:60078 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:26:59.117160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:27:14.619634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:27:30.250334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:30.250369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:30.250384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:27:30.250388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:27:30.138Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 111 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d77afdc0-00fb-4d1b-8971-7270c1ea9a20" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54948 10.132.0.36:443 10.132.0.17:37968 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:27:30.505924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:27:30.505963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:27:30.505977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:27:30.505982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T00:27:30.442Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 63 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "cf569983-f074-482d-ba74-9e09f6a52309" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:43430 10.132.0.36:443 10.132.0.17:37982 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:27:31.569520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:27:44.100490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:27:49.039122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:27:54.188Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 74 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1e899cfc-0c78-41d9-8110-522df3c4bb75" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:57688 10.132.0.36:443 10.132.0.17:51864 - v1-completions-path 2026-11-03T00:27:55.830955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:27:55.830993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:27:55.831008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:27:55.831013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:27:55.780Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 50 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "36d6254e-f60b-49f0-9b75-602e3d7f4803" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:43430 10.132.0.36:443 10.132.0.17:51872 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:28:09.473073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:28:39.726Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 69 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "9134b50c-54df-4cb3-8d9c-fe7594c73d5b" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:51156 10.132.0.36:443 10.132.0.17:47924 - v1-completions-path [2026-11-03T00:28:55.146Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 71 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d938fdd2-a1cf-4fb4-a063-00cb6dec9066" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:51156 10.132.0.36:443 10.132.0.17:41656 - v1-completions-path 2026-11-03T00:28:56.863885Z info ads ADS: new connection for node:9 2026-11-03T00:28:56.868709Z info cache read certificate from file resource=file-root:system 2026-11-03T00:29:00.776987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:29:01.977405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:29:07.303721Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"1333","StreamId":"18111996652514555961"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-11-03T00:29:07.234Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 69 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d821f23e-35af-45ff-b450-4863ed21354f" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.0.36:443 10.132.0.17:47128 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T00:29:16.473173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:29:16.473203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:29:16.473212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:29:16.473216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:29:16.473363Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:29:16.348Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 124 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "47a7ddd7-4051-40f8-95af-12b46c0f10a2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59276 10.132.0.36:443 10.132.0.17:57170 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:29:18.793147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:18.793175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:18.793185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:29:18.793188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:18.793336Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:29:18.681Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 111 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "11fa2c42-1721-4609-8cb2-2ade1123b3a5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59290 10.132.0.36:443 10.132.0.17:57186 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:29:30.360182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:30.360210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:30.360219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:30.360223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:29:30.360361Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:29:30.254Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 105 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "2da1af2a-9097-406c-8fcf-700675ed1c2a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59290 10.132.0.36:443 10.132.0.17:46024 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:29:32.676089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:32.676152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:32.676169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:32.676175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:29:32.676392Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:29:32.566Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1707 110 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "3b7efb0e-22a1-426b-bba1-aca4589d815d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59290 10.132.0.36:443 10.132.0.17:46028 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:29:34.994031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:34.994069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:34.994081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:29:34.994087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:34.994298Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:29:34.873Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1707 120 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1700307a-33ea-4bf9-9af7-665fda7214d4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59290 10.132.0.36:443 10.132.0.17:46044 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:29:53.081269Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T00:30:12.250202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:30:12.250238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:30:12.250251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:30:12.250257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:30:12.250444Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:30:12.137Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 113 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "74923f0b-e498-4af0-a4a2-cf30077ce316" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59290 10.132.0.36:443 10.132.0.17:60342 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:14.549363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:14.549396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:14.549408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:14.549412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:30:14.549563Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:30:14.448Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 101 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "afa1deff-9f32-4fc4-a002-4dba340b62eb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59276 10.132.0.36:443 10.132.0.17:60348 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:23.815168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:23.815201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:23.815212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:30:23.815216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:23.815377Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:30:23.710Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1707 105 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d809d498-d86d-4a4f-a12f-7a4cded542d8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59276 10.132.0.36:443 10.132.0.17:54974 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:28.430229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:30:28.430268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:30:28.430281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:30:28.430287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:30:28.430458Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:30:28.322Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 107 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "868f00b6-c2e5-4b5b-8317-e69bdd34630e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59290 10.132.0.36:443 10.132.0.17:54994 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:30.740438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:30.740472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:30.740483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:30.740488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:30:30.740656Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:30:30.635Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 104 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f3b503f8-5aa0-4659-b3cd-e83ebb994832" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:59276 10.132.0.36:443 10.132.0.17:58096 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:57.488333Z info ads ADS: "" 9 terminated 2026-11-03T00:30:57.530457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:31:00.262325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:31:10.916946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:31:29.392180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:31:34.054659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:31:36.630282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:36.630322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:36.630342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:31:36.630348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:31:36.454Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 176 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "452ca455-b6a1-420e-9035-9619478d1b0b" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:56700 10.132.0.36:443 10.132.0.17:36350 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T00:31:37.891Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f1edd13e-bdda-4fc5-aaa2-3139d8ca7a13" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:33688 10.132.0.36:443 10.132.0.17:36364 - v1-completions-path 2026-11-03T00:31:58.158540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:32:11.344389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:32:17.955909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:32:17.955945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:32:17.955959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:32:17.955964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:32:17.842Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 113 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "3ddfa860-dd8e-437a-b401-5d74003250e4" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:59308 10.132.0.36:443 10.132.0.17:49660 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T00:32:21.083Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "0377d906-fb88-4fcc-92de-eca5e490ff6f" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:57688 10.132.0.36:443 10.132.0.17:43350 - v1-completions-path [2026-11-03T00:32:22.902Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e3c855f7-4438-48c1-8195-8831ab30566e" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:57688 10.132.0.36:443 10.132.0.17:43362 - v1-completions-path 2026-11-03T00:32:42.236508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:32:52.921942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:32:59.415188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:33:10.807Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "05bebeab-e592-4208-8cc0-c12232fdbed4" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:57688 10.132.0.36:443 10.132.0.17:40174 - v1-completions-path [2026-11-03T00:33:13.443Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "8c548d02-7505-461e-a1ce-d003c2f9d614" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:57688 10.132.0.36:443 10.132.0.17:40176 - v1-completions-path 2026-11-03T00:33:27.776767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:33:32.347336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:33:32.928Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 289 103 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "65c07452-82e0-44a3-a07a-bc2b2206ce37" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.28:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:58666 10.132.0.36:443 10.132.0.17:51322 - v1-completions-path 2026-11-03T00:33:45.665663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:33:52.265675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:06.747799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:11.437622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:24.981270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:38.369358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:44.335456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:02.762722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:35:07.319Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 79 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1f03f1b3-ca9a-4b16-9499-f87eb4e4fefe" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.132.0.17:58746 - v1-completions-path 2026-11-03T00:35:08.396375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:19.876661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:32.112059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:35:32.112098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:35:32.112115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:35:32.112153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:35:31.999Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 112 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "11955bcd-a04d-492c-83e9-48b2ca20b39c" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:52314 10.132.0.36:443 10.132.0.17:59752 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:35:46.381406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:57.049307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:36:15.715243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:36:23.431768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:39:04.448236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:39:04.448271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:39:04.448287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:39:04.448291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:39:04.329Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 118 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e43fc242-6309-46eb-bbf2-8091e2e5a919" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54532 10.132.0.36:443 10.132.0.17:58652 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:39:20.122717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:40:26.711665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:40:26.711702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:40:26.711718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:40:26.711722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:40:26.598Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 113 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d6989762-25e1-4758-ac4f-dd9f7ce640d0" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:56508 10.132.0.36:443 10.132.0.17:42574 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:40:48.520580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:05.909552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:10.688897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:24.040981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:39.814807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:44.760805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:42:04.671173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:42:15.472545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:42:21.794792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:42:34.674Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "435a4049-7f4b-4308-92f8-216e0bf06e6b" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:33688 10.132.0.36:443 10.132.0.17:47278 - v1-completions-path [2026-11-03T00:42:35.317Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "ee9daa27-f07c-443a-b1ac-8cd61abfe802" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:33688 10.132.0.36:443 10.132.0.17:47286 - v1-completions-path 2026-11-03T00:42:37.344609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:42:37.344647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:42:37.344662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:42:37.344667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:42:37.231Z] "DELETE /v1/api-keys/709d6a38-d291-4d97-9e70-65cf9047958a HTTP/1.1" 200 - via_upstream - "-" 0 365 112 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f9cbab83-f874-4cd2-89b8-5308616c9d34" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.243:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54406 10.132.0.36:443 10.132.0.17:47288 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:42:50.995485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:42:57.432859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:43:03.546598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:43:13.131Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "8de9a164-db15-49d1-875b-0c509592b8c3" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:33688 10.132.0.36:443 10.132.0.17:60638 - v1-completions-path [2026-11-03T00:43:17.403Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 61 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "03ed695d-a74a-41ce-9580-6d5b2c5508fd" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:33688 10.132.0.36:443 10.132.0.17:60662 - v1-completions-path [2026-11-03T00:43:18.112Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 67 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "7ed2a5e4-f5f8-477e-8163-52840c1d613f" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:33688 10.132.0.36:443 10.132.0.17:60676 - v1-completions-path 2026-11-03T00:43:35.691388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:43:46.304657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:43:52.796759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:43:58.776636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:44:07.237588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:44:07.237623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:44:07.237637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:44:07.237642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:44:07.123Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 114 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "b39f4344-a56a-4216-9673-c716b1c700d6" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.243:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:56160 10.132.0.36:443 10.132.0.17:58192 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:44:11.054178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:44:18.306Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a778346e-149d-4906-a3b5-8470fc12ffee" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:57688 10.132.0.36:443 10.132.0.17:50122 - v1-completions-path [2026-11-03T00:44:18.665Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "86de69ce-402e-4167-8596-5b46ead7a7e8" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:33688 10.132.0.36:443 10.132.0.17:50130 - v1-completions-path [2026-11-03T00:44:20.113Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "435a3521-6203-441c-9c47-132e412ea7ee" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:57688 10.132.0.36:443 10.132.0.17:49352 - v1-completions-path 2026-11-03T00:44:34.486389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:44:45.119558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:44:49.999248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:08.395415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:15.371357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:24.768395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:45.113924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:57.784897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:46:17.945320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:46:28.977030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:46:39.927233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:46:50.560632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:47:01.358790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:47:12.146905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:47:22.905959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:47:33.539687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:47:39.991Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 65 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "224634ef-9db6-41b7-a54d-ceba2cb962bb" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:39574 10.132.0.36:443 10.132.0.17:56966 - v1-completions-path