2026-11-03T22:12:59.456602Z info FLAG: --concurrency="0" 2026-11-03T22:12:59.456628Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T22:12:59.456632Z info FLAG: --help="false" 2026-11-03T22:12:59.456635Z info FLAG: --log_as_json="false" 2026-11-03T22:12:59.456637Z info FLAG: --log_caller="" 2026-11-03T22:12:59.456638Z info FLAG: --log_output_level="default:info" 2026-11-03T22:12:59.456641Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T22:12:59.456645Z info FLAG: --log_target="[stdout]" 2026-11-03T22:12:59.456648Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T22:12:59.456650Z info FLAG: --outlierLogPath="" 2026-11-03T22:12:59.456652Z info FLAG: --profiling="true" 2026-11-03T22:12:59.456654Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T22:12:59.456656Z info FLAG: --proxyLogLevel="warning" 2026-11-03T22:12:59.456658Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T22:12:59.456660Z info FLAG: --stsPort="0" 2026-11-03T22:12:59.456662Z info FLAG: --templateFile="" 2026-11-03T22:12:59.456664Z info FLAG: --tokenManagerPlugin="" 2026-11-03T22:12:59.456666Z info FLAG: --vklog="0" 2026-11-03T22:12:59.456669Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T22:12:59.456827Z info Proxy role ips=[10.134.0.195] type=router id=maas-default-gateway-openshift-default-8b9c49cd7-r666f.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T22:12:59.456871Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T22:12:59.457970Z info cpu limit detected as 2, setting concurrency 2026-11-03T22:12:59.458189Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T22:12:59.458200Z info JWT policy is third-party-jwt 2026-11-03T22:12:59.458202Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T22:12:59.459815Z info Starting default Istio SDS Server 2026-11-03T22:12:59.459843Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T22:12:59.459862Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T22:12:59.460207Z info Opening status port 15020 2026-11-03T22:12:59.461150Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T22:12:59.462896Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T22:12:59.463773Z info Starting proxy agent 2026-11-03T22:12:59.463804Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T22:12:59.472817Z info sds Starting SDS grpc server 2026-11-03T22:12:59.472845Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T22:12:59.528763Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T22:12:59.682107Z info ads ADS: new connection for node:1 2026-11-03T22:12:59.683340Z info ads ADS: new connection for node:2 2026-11-03T22:12:59.864227Z info cache generated new workload certificate resourceName=default latency=403.3114ms ttl=23h59m59.135777136s 2026-11-03T22:12:59.864264Z info cache Root cert has changed, start rotating root cert 2026-11-03T22:12:59.864308Z info cache returned workload trust anchor from cache ttl=23h59m59.135693562s 2026-11-03T22:12:59.864318Z info cache returned workload trust anchor from cache ttl=23h59m59.135682322s 2026-11-03T22:12:59.864333Z info cache returned workload certificate from cache ttl=23h59m59.135667483s 2026-11-03T22:12:59.864731Z info cache returned workload trust anchor from cache ttl=23h59m59.135270403s 2026-11-03T22:12:59.956939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:13:08.119713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:13:09.059414Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T22:13:10.124046Z info Readiness succeeded in 10.669760994s 2026-11-03T22:13:10.124406Z info Envoy proxy is ready 2026-11-03T22:13:12.257768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:13:15.309795Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=27 [2026-11-03T22:13:15.221Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 88 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "918deb1a-7c8a-4b06-9ae4-f53a71e11203" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:51220 10.134.0.195:443 10.132.0.21:38102 - v1-catch-all-path 2026-11-03T22:13:29.293333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:13:41.023162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:13:44.604910Z info ads ADS: new connection for node:3 2026-11-03T22:13:44.605418Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T22:13:44.605457Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T22:13:48.011908Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:14:26.926806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:14:29.868631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:14:29.868761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:14:29.868819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 2026-11-03T22:14:29.868854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 [2026-11-03T22:14:29.657Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 211 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3700b741-47a0-44b2-a561-7b5294ff00e7" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:54434 10.134.0.195:443 10.132.0.21:40664 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:14:51.980346Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T22:14:52.033911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:14:55.658019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:14:55.658052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:14:55.658064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:14:55.658070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 [2026-11-03T22:14:55.543Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 333 114 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "cedfde1a-3bad-4585-9320-90e1b5a938ec" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:54434 10.134.0.195:443 10.132.0.21:57954 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T22:14:55.852Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 74 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "006428e5-be86-48e1-b578-1538c580585b" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:59430 10.134.0.195:443 10.132.0.21:57962 - v1-completions-path 2026-11-03T22:14:56.428132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:15:13.162425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:18:00.376929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:18:30.172707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:19:00.574308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:19:16.143916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:19:31.272050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:19:43.737706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:19:48.859776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:19:51.937936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:19:51.937970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:19:51.937983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:19:51.937988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 [2026-11-03T22:19:51.827Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 110 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "49598fa0-51ad-4eaf-980b-0fc4cfbc015e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:56738 10.134.0.195:443 10.132.0.21:35780 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:19:54.366003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=27 [2026-11-03T22:19:54.309Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 86 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "62e4aef4-4c5e-438f-bcda-473eadba28ad" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:35792 - v1-completions-path [2026-11-03T22:19:54.600Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "7f41c16d-aee8-4e63-864f-5f6a8745ba84" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:35808 - v1-completions-path 2026-11-03T22:20:09.697196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:20:11.882846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:20:11.882882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:20:11.882894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:20:11.882899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 [2026-11-03T22:20:11.771Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 111 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "20bdc3e6-20ab-42a8-87b6-2df149ac9434" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:56738 10.134.0.195:443 10.132.0.21:54614 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T22:20:55.550Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 73 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "de735896-371d-4acb-b0b2-c87004e6d673" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:59430 10.134.0.195:443 10.132.0.21:53212 - v1-completions-path 2026-11-03T22:20:57.368824Z info ads ADS: new connection for node:4 2026-11-03T22:20:57.374933Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T22:20:57.375045Z info cache read certificate from file resource=file-root:system 2026-11-03T22:21:01.232928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:21:02.392387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:21:05.426109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:21:05.426142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:21:05.426154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 2026-11-03T22:21:05.426159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:21:05.701211Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"164","StreamId":"17155765885101596429"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-03T22:21:05.318Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 107 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c907a0c1-1f4b-4636-abe7-1f10f922de2e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:56738 10.134.0.195:443 10.132.0.21:53986 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T22:21:05.642Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "af5a3091-357f-4946-9618-8dd581b45fcd" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.195:443 10.132.0.21:53994 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T22:21:24.536411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:21:24.536449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:21:24.536462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:21:24.536468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 2026-11-03T22:21:24.536652Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=27 [2026-11-03T22:21:24.339Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1537 197 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "219214fe-3046-476e-ae90-5948bd2b8060" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.195:43176 10.134.0.195:443 10.132.0.21:57222 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:11.853963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:11.853995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T22:22:11.854008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:11.854026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:11.854031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:22:11.854258Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T22:22:11.654Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1538 199 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "39fc8b3e-a63e-4f6e-9f09-8c12d03a569a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.195:46568 10.134.0.195:443 10.132.0.21:53042 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:57.779887Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T22:22:58.169499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:58.169538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:58.169553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:22:58.169558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T22:22:58.052Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 116 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "1df163d8-68bd-4066-b80a-8cc95897dd64" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:44918 10.134.0.195:443 10.132.0.21:41468 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:22:59.431554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:23:00.458599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:23:02.430457Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=27 2026-11-03T22:23:02.430575Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=27 2026-11-03T22:23:02.430605Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=27 2026-11-03T22:23:02.430630Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=27 [2026-11-03T22:23:02.387Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 43 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "7e038c9b-491a-48fe-8cd0-bd80d49e888e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.195:443 10.132.0.21:41474 - v1-completions-path 2026-11-03T22:23:11.182345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:23:29.678248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:23:34.321925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-03T22:23:38.570Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c2b1e74d-caa6-4d44-ac97-c3ac8f026582" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:47630 - v1-completions-path [2026-11-03T22:23:39.366Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c0732f10-aac6-4a18-9649-445d26739080" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:47644 - v1-completions-path [2026-11-03T22:23:39.605Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "2470d7f3-5412-4360-ba8a-6e9e5b3b931a" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:42944 10.134.0.195:443 10.132.0.21:47658 - v1-completions-path [2026-11-03T22:23:40.672Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "28df973c-47b7-4f50-b2b5-26bbb08a9f43" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:42944 10.134.0.195:443 10.132.0.21:47674 - v1-completions-path 2026-11-03T22:23:41.490230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:23:41.490275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:23:41.490295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:23:41.490301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 [2026-11-03T22:23:41.434Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 55 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "88f36b2f-3658-43e8-ae8d-46f9bee903a7" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:47690 - v1-catch-all-path 2026-11-03T22:23:58.889832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:24:12.017358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:24:18.321152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:24:18.321187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:24:18.321206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:24:18.321212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T22:24:18.206Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 114 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "74e48440-ecdb-4e1c-8fc1-c4fddb9cc927" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:43540 10.134.0.195:443 10.132.0.21:45812 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T22:24:19.232Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "9c69099c-f610-4919-8ce6-f4c0bc0f5d42" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:45824 - v1-completions-path [2026-11-03T22:24:24.710Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "abced9fe-fa01-451f-8cea-0bb08bf02e15" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:42944 10.134.0.195:443 10.132.0.21:45848 - v1-completions-path 2026-11-03T22:24:42.640095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:24:53.249570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:24:59.752291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-03T22:25:10.912Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "390564b6-f5bc-4c8e-831a-a88618e4d572" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:51576 - v1-completions-path [2026-11-03T22:25:13.522Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 54 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "42ca29da-31ec-4644-a2b1-05909bced97e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:51584 - v1-completions-path 2026-11-03T22:25:28.115928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:25:32.957328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:25:46.538627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:25:55.745264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:26:06.320528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:26:12.862285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:26:27.753274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:26:39.837523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:26:44.824301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:27:03.343773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:27:09.046850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:27:20.388087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:27:46.711884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:27:57.442089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:28:17.157916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:28:24.450172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:30:51.549556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:32:18.997193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:32:46.588128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:32:51.275064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-03T22:32:51.987Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 94 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "eff2674c-0315-4133-ab98-4509de296c3c" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:59430 10.134.0.195:443 10.132.0.21:60058 - v1-completions-path 2026-11-03T22:33:04.062465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:33:21.026277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:33:25.728879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-03T22:33:29.589Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f80ad651-07a3-4b0b-82c4-f53270af7d17" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:45830 - v1-completions-path [2026-11-03T22:33:31.286Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "fec8cd15-c90c-45c9-83bf-aac4b1af9fa0" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:45834 - v1-completions-path 2026-11-03T22:33:46.171907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:33:56.647291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:34:02.712311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:34:15.851342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:34:15.851379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-03T22:34:15.851393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 2026-11-03T22:34:15.851398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 [2026-11-03T22:34:15.739Z] "DELETE /v1/api-keys/232a71eb-3946-4c6d-b2fe-34b918b93415 HTTP/1.1" 200 - via_upstream - "-" 0 365 111 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "5e23e753-d094-491a-adad-78385f5d65a1" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.201:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:49184 10.134.0.195:443 10.132.0.21:35772 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:34:29.893820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:34:36.032333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:34:42.106954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-03T22:34:56.024Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 67 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b24d74a6-0ab4-4238-ad99-787f381fa50e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:40678 - v1-completions-path 2026-11-03T22:34:58.878968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:34:58.879004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:34:58.879017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:34:58.879023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T22:34:58.762Z] "DELETE /v1/api-keys/ddaa9962-d848-448a-8d67-aacfddbc0b72 HTTP/1.1" 200 - via_upstream - "-" 0 365 116 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b78743c8-363e-48c5-901c-809887f10eba" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.201:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:54632 10.134.0.195:443 10.132.0.21:51016 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:35:12.606756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:35:23.318159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:35:29.590936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:35:35.438889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:35:47.922283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-03T22:35:55.449Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 67 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "871dc9b4-b182-4f51-8a80-0854d4438845" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:53478 10.134.0.195:443 10.132.0.21:37324 - v1-completions-path 2026-11-03T22:35:57.772955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:35:57.772994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:35:57.773008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:35:57.773013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T22:35:57.661Z] "DELETE /v1/api-keys/836c309e-b28a-4cf6-a88f-5fa4bf2a920d HTTP/1.1" 200 - via_upstream - "-" 0 367 111 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b872928d-e3a1-45e0-a9a4-e9aa1751d7a7" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.201:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.195:54632 10.134.0.195:443 10.132.0.21:48458 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:36:11.306786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:36:21.993214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:36:26.798893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:36:45.080499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:36:51.195762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:37:12.844814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:37:34.765896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:37:56.827605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:38:16.624668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:38:27.486190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:38:38.416209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:38:49.106306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:38:59.914683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-03T22:39:10.567971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-03T22:39:16.959Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 69 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "6f7e38c8-23aa-4942-848d-7ec6b3b38c9e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.195:59430 10.134.0.195:443 10.132.0.21:42274 - v1-completions-path