2026-11-01T00:28:56.986431Z info FLAG: --concurrency="0" 2026-11-01T00:28:56.986452Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T00:28:56.986456Z info FLAG: --help="false" 2026-11-01T00:28:56.986459Z info FLAG: --log_as_json="false" 2026-11-01T00:28:56.986461Z info FLAG: --log_caller="" 2026-11-01T00:28:56.986463Z info FLAG: --log_output_level="default:info" 2026-11-01T00:28:56.986465Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T00:28:56.986469Z info FLAG: --log_target="[stdout]" 2026-11-01T00:28:56.986472Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T00:28:56.986474Z info FLAG: --outlierLogPath="" 2026-11-01T00:28:56.986476Z info FLAG: --profiling="true" 2026-11-01T00:28:56.986478Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T00:28:56.986480Z info FLAG: --proxyLogLevel="warning" 2026-11-01T00:28:56.986482Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T00:28:56.986484Z info FLAG: --stsPort="0" 2026-11-01T00:28:56.986486Z info FLAG: --templateFile="" 2026-11-01T00:28:56.986488Z info FLAG: --tokenManagerPlugin="" 2026-11-01T00:28:56.986491Z info FLAG: --vklog="0" 2026-11-01T00:28:56.986494Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T00:28:56.986688Z info Proxy role ips=[10.134.1.161] type=router id=maas-default-gateway-openshift-default-6cc458d887-qggpk.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T00:28:56.986735Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T00:28:56.987962Z info cpu limit detected as 2, setting concurrency 2026-11-01T00:28:56.988653Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T00:28:56.988675Z info JWT policy is third-party-jwt 2026-11-01T00:28:56.988680Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T00:28:56.991423Z info Starting default Istio SDS Server 2026-11-01T00:28:56.991443Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T00:28:56.991409Z info Opening status port 15020 2026-11-01T00:28:56.991461Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T00:28:56.992666Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T00:28:56.994017Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T00:28:56.994855Z info Starting proxy agent 2026-11-01T00:28:56.994885Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T00:28:57.009593Z info sds Starting SDS grpc server 2026-11-01T00:28:57.009632Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T00:28:57.061199Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T00:28:57.066108Z info cache generated new workload certificate resourceName=default latency=73.209543ms ttl=23h59m59.933894781s 2026-11-01T00:28:57.066138Z info cache Root cert has changed, start rotating root cert 2026-11-01T00:28:57.066172Z info cache returned workload trust anchor from cache ttl=23h59m59.933828086s 2026-11-01T00:28:57.189219Z info ads ADS: new connection for node:1 2026-11-01T00:28:57.189363Z info cache returned workload certificate from cache ttl=23h59m59.81063865s 2026-11-01T00:28:57.189483Z info ads ADS: new connection for node:2 2026-11-01T00:28:57.189552Z info cache returned workload trust anchor from cache ttl=23h59m59.810449072s 2026-11-01T00:28:57.274594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:29:05.345900Z info Readiness succeeded in 8.36297111s 2026-11-01T00:29:05.346299Z info Envoy proxy is ready 2026-11-01T00:29:23.987462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T00:29:26.744Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 147 412 110 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5a74e723-45ac-41a1-a686-fc4dd27a3713" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.0.44:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:41604 10.134.1.161:443 10.132.0.9:38724 - v1-chat-completions-path 2026-11-01T00:29:39.787415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:29:42.255222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:29:48.605999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:29:51.980714Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T00:29:51.906Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3468e8ea-5638-452d-b21c-1e1a2bd46bc2" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:46636 10.134.1.161:443 10.132.0.9:42616 - v1-catch-all-path 2026-11-01T00:29:55.689852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:30:05.615100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:30:20.412126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:30:31.410641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:30:33.481991Z info ads ADS: new connection for node:3 2026-11-01T00:30:33.482272Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T00:30:33.482339Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T00:30:34.483115Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:31:15.926784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T00:31:19.061Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 357 101 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4b8718a0-0e36-4794-8b3a-01b88914211f" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.1.164:8000" outbound|54321||e2e-prio-pool-ca03fe61-inference-pool-ip-13923081.llm.svc.cluster.local 10.134.1.161:59174 10.134.1.161:443 10.132.0.9:36002 - v1-model-routing [2026-11-01T00:31:21.143Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 329 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "fa3e7dec-9890-4c71-9c22-e1b38380a9eb" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.1.164:8000" outbound|54321||e2e-prio-pool-ca03fe61-inference-pool-ip-13923081.llm.svc.cluster.local 10.134.1.161:59174 10.134.1.161:443 10.132.0.9:36010 - v1-model-routing 2026-11-01T00:31:35.243599Z info ads ADS: "" 3 terminated 2026-11-01T00:31:35.323382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:31:37.724527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:31:40.554627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:31:45.635291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:34:05.265127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:34:21.880117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:34:38.331440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:34:50.296368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:34:54.127662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:35:05.899167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:35:09.451977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:35:12.324988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:35:12.325032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:35:12.325050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:35:12.325056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T00:35:12.255Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 69 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1f2a935c-647c-41ac-b2a4-32f34646d943" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.161:58656 10.134.1.161:443 10.132.0.9:48048 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T00:35:12.607Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 76 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "598d0418-0a10-4dea-a65f-afeea70c3cbe" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:42728 10.134.1.161:443 10.132.0.9:48050 - v1-completions-path [2026-11-01T00:35:12.912Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2f869e27-96c6-4452-9b3e-89340ca50391" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.161:443 10.132.0.9:48060 - v1-completions-path 2026-11-01T00:35:25.117642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:36:12.258390Z info ads ADS: new connection for node:4 2026-11-01T00:36:12.263054Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T00:36:12.263165Z info cache read certificate from file resource=file-root:system 2026-11-01T00:36:13.434720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:36:14.983238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:36:19.857306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-01T00:36:19.861591Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"143","StreamId":"15209483027113191772"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-01T00:36:19.793Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 67 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "6df1618c-c4de-4377-9bd3-1ce9d83ce738" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.1.161:443 10.132.0.9:55932 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-01T00:36:24.036271Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"148","StreamId":"1313458467169621936"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-01T00:36:23.975Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "213443e7-4085-49a0-8fad-5aa3509c6d4d" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.1.161:443 10.132.0.9:33104 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-01T00:36:45.439258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:36:45.439293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:36:45.439303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:36:45.439307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T00:36:45.439463Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T00:36:45.329Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 110 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5a24218f-8078-4e18-aa3e-f88502591c94" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.161:43736 10.134.1.161:443 10.132.0.9:56368 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:36:51.838976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:51.839012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:51.839026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:51.839032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:36:51.839233Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T00:36:51.735Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 103 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "c2a44d88-2a13-4dcd-ba6e-7b5dbf93cff6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.161:49550 10.134.1.161:443 10.132.0.9:42688 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:37:00.305613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-01T00:37:00.344141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:00.344173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:00.344185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:00.344189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:37:00.344346Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T00:37:00.249Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 94 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f5617a92-f606-4397-94b8-680301cff870" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.161:49550 10.134.1.161:443 10.132.0.9:42700 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:37:21.279031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:37:21.279068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:37:21.279081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T00:37:21.279087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:37:21.279305Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T00:37:21.181Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 97 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "cffc6c81-0d08-4ada-81d0-35be8a277dc4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.161:43736 10.134.1.161:443 10.132.0.9:40108 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:37:56.815158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:37:56.928993Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T00:37:57.168302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:57.168342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:57.168359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:57.168365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:37:57.085Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 83 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e670a53c-e0fb-4356-8259-c4b86ccc35d0" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.161:58270 10.134.1.161:443 10.132.0.9:35354 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:37:58.299691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:38:05.076741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T00:38:08.471Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "7fce3037-6801-4a5b-9f52-1d302a3bac23" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:42728 10.134.1.161:443 10.132.0.9:35420 - v1-completions-path 2026-11-01T00:38:20.733550Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:38:25.263217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:38:40.544840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:38:56.576166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:39:01.615799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:01.615844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:01.615867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:01.615873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T00:39:01.537Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 320 78 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "42cba03a-b5a6-4363-a0c9-236506f9bc0c" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.161:34518 10.134.1.161:443 10.132.0.9:37460 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T00:39:02.912Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ebcf6f1b-f3b2-41e3-8c8e-2c933501be1d" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:42728 10.134.1.161:443 10.132.0.9:37468 - v1-completions-path [2026-11-01T00:39:03.328Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5e214ff4-0467-4d6a-af6d-780547c3d649" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:48754 10.134.1.161:443 10.132.0.9:37480 - v1-completions-path [2026-11-01T00:39:03.858Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "37806ff0-0fb8-4103-8758-78653a00d6bc" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:42728 10.134.1.161:443 10.132.0.9:37486 - v1-completions-path 2026-11-01T00:39:19.999105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:39:30.334476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:39:34.889768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T00:39:39.186Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "69908e79-c87e-41ac-b8cf-d8c37b8818c5" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:48754 10.134.1.161:443 10.132.0.9:55118 - v1-completions-path 2026-11-01T00:39:51.835458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:39:54.207223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:40:01.262710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:40:13.184585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:40:18.404009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:40:26.764666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:40:31.972051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:40:50.277994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:40:53.251701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:41:10.059629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:41:10.059672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:41:10.059692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:41:10.059697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T00:41:09.977Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 81 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2bce5f61-f6cc-40d5-9994-532e875a618f" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.161:33406 10.134.1.161:443 10.132.0.9:37306 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:41:17.117676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:41:35.076537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:41:45.372119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:41:49.673596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:41:49.673643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:41:49.673664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:41:49.673671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:41:49.596Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 77 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9b4ded1a-a142-42c1-865b-c8fe2daf752d" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.161:59414 10.134.1.161:443 10.132.0.9:58060 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:45:26.172218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:45:29.629949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:45:29.629984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:45:29.630000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:45:29.630005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T00:45:29.551Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 78 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "59e53045-3c9c-47d2-b0c6-ffd46e49a63d" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.161:57448 10.134.1.161:443 10.132.0.9:38538 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:45:41.559331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:45:43.845089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:45:44.327641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:45:44.327698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:45:44.327726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:45:44.327734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T00:45:44.212Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 114 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5de48a6a-63fb-4feb-8dbc-05772dc28bbb" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.161:56472 10.134.1.161:443 10.132.0.9:36894 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:45:51.009601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:46:10.775090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:46:14.372265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T00:46:17.406Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5cf6cc2a-699e-4f23-b29c-0edc9d9c748a" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:48754 10.134.1.161:443 10.132.0.9:37824 - v1-completions-path 2026-11-01T00:46:29.963591Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:46:40.370610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:46:45.443438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T00:46:49.382Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "405f78d9-885f-4a45-b885-59c65d4bf072" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:48754 10.134.1.161:443 10.132.0.9:49836 - v1-completions-path 2026-11-01T00:47:02.482149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:47:06.928853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:47:10.470020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T00:47:16.859Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "603dc7d4-7e1b-4be6-98da-b83c5530943c" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:48754 10.134.1.161:443 10.132.0.9:49388 - v1-completions-path [2026-11-01T00:47:17.229Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "53d4e717-95d1-4b10-963a-a5943c810c19" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:42728 10.134.1.161:443 10.132.0.9:49402 - v1-completions-path [2026-11-01T00:47:18.039Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e3d9b586-afe1-46ac-aeec-acb1c7bd74c4" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:42728 10.134.1.161:443 10.132.0.9:49408 - v1-completions-path [2026-11-01T00:47:18.774Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "58196328-1f49-424c-afa7-911638ac0664" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:42728 10.134.1.161:443 10.132.0.9:49424 - v1-completions-path 2026-11-01T00:47:21.158501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:47:21.158542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:47:21.158558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T00:47:21.158563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T00:47:20.449Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "7b238130-6a5e-4fb2-a9f7-fe1874abd073" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:48754 10.134.1.161:443 10.132.0.9:49450 - v1-completions-path [2026-11-01T00:47:20.999Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "827b0df0-1105-4818-bd44-367da210538d" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.161:443 10.132.0.9:49458 - v1-completions-path [2026-11-01T00:47:21.079Z] "DELETE /v1/api-keys/00e7f4ae-5d4a-4c9e-8716-4c56e35da767 HTTP/1.1" 200 - via_upstream - "-" 0 363 79 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3605997c-2221-464b-9fd6-ce2ee222d2dd" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.1.112:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.161:44908 10.134.1.161:443 10.132.0.9:49462 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:47:33.134715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:47:43.464564Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:47:47.937012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:47:51.384042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:47:56.275982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T00:48:02.310Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 65 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2cd46b70-c946-47b2-99d4-ab97dca64db5" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.161:48754 10.134.1.161:443 10.132.0.9:58206 - v1-completions-path 2026-11-01T00:48:14.795132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:48:25.103535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:48:27.324686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:48:36.956049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:48:40.528606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:48:58.342662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:49:00.629356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:49:19.053151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:49:29.487877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:49:40.011778Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:49:50.275421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:50:00.636162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:50:10.988557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:50:21.375233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:50:31.722499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:50:41.993457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T00:50:52.355128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9