2026-11-03T04:08:34.679998Z info FLAG: --concurrency="0" 2026-11-03T04:08:34.680018Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T04:08:34.680022Z info FLAG: --help="false" 2026-11-03T04:08:34.680025Z info FLAG: --log_as_json="false" 2026-11-03T04:08:34.680026Z info FLAG: --log_caller="" 2026-11-03T04:08:34.680028Z info FLAG: --log_output_level="default:info" 2026-11-03T04:08:34.680030Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T04:08:34.680035Z info FLAG: --log_target="[stdout]" 2026-11-03T04:08:34.680037Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T04:08:34.680039Z info FLAG: --outlierLogPath="" 2026-11-03T04:08:34.680041Z info FLAG: --profiling="true" 2026-11-03T04:08:34.680043Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T04:08:34.680045Z info FLAG: --proxyLogLevel="warning" 2026-11-03T04:08:34.680047Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T04:08:34.680049Z info FLAG: --stsPort="0" 2026-11-03T04:08:34.680051Z info FLAG: --templateFile="" 2026-11-03T04:08:34.680053Z info FLAG: --tokenManagerPlugin="" 2026-11-03T04:08:34.680055Z info FLAG: --vklog="0" 2026-11-03T04:08:34.680058Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T04:08:34.680221Z info Proxy role ips=[10.132.0.134] type=router id=maas-default-gateway-openshift-default-76f4876667-9znf5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T04:08:34.680270Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T04:08:34.681490Z info cpu limit detected as 2, setting concurrency 2026-11-03T04:08:34.681697Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T04:08:34.681707Z info JWT policy is third-party-jwt 2026-11-03T04:08:34.681710Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T04:08:34.683645Z info Starting default Istio SDS Server 2026-11-03T04:08:34.683669Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T04:08:34.683692Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T04:08:34.684350Z info Opening status port 15020 2026-11-03T04:08:34.684784Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T04:08:34.685584Z info sds Starting SDS grpc server 2026-11-03T04:08:34.685599Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T04:08:34.686699Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T04:08:34.687456Z info Starting proxy agent 2026-11-03T04:08:34.687486Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T04:08:34.766018Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T04:08:34.863075Z info cache generated new workload certificate resourceName=default latency=177.345647ms ttl=23h59m59.136935934s 2026-11-03T04:08:34.863122Z info cache Root cert has changed, start rotating root cert 2026-11-03T04:08:34.863161Z info cache returned workload trust anchor from cache ttl=23h59m59.136839905s 2026-11-03T04:08:34.988652Z info ads ADS: new connection for node:1 2026-11-03T04:08:34.988728Z info cache returned workload certificate from cache ttl=23h59m59.01127408s 2026-11-03T04:08:34.989781Z info ads ADS: new connection for node:2 2026-11-03T04:08:34.990290Z info cache returned workload trust anchor from cache ttl=23h59m59.009712596s 2026-11-03T04:08:35.090696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:08:43.621320Z info Readiness succeeded in 8.943576359s 2026-11-03T04:08:43.621749Z info Envoy proxy is ready 2026-11-03T04:13:11.657325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:14:14.999549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:16:55.258585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:18:36.284710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:27:52.054762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:27:52.239469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T04:27:52.239514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T04:27:52.239530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T04:27:52.239536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T04:27:52.081Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 157 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "af432685-593e-4099-a4fb-3b08f3cf0f94" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.134:48500 10.132.0.134:443 10.132.0.10:59092 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T04:28:19.179215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:28:55.432032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:28:57.867531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:28:57.867569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:28:57.867585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T04:28:57.867589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T04:28:57.415Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 304 452 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "498100bc-b16d-4d95-8ac7-5c65063ed046" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.134:44068 10.132.0.134:443 10.132.0.10:59248 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T04:29:14.654239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:29:19.953506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:29:23.308167Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T04:29:23.233Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 75 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "79d4a44f-bf62-4d2c-8340-c147e50e2c0f" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.134:55224 10.132.0.134:443 10.132.0.10:41526 - v1-catch-all-model-routing 2026-11-03T04:29:29.743279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:29:35.543725Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 2026-11-03T04:29:36.289171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T04:29:35.472Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 71 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "29504fb1-2ff4-4fc0-98f3-b2dfbcdf59e3" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.134:55224 10.132.0.134:443 10.132.0.10:44508 - v1-catch-all-path [2026-11-03T04:29:36.230Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 59 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "fead0836-a1a9-4f12-b930-31974f4baeea" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.134:443 10.132.0.10:44512 - v1-catch-all-path 2026-11-03T04:29:43.965256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:29:53.429113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:30:10.735292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:30:22.567709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:30:26.589848Z info ads ADS: new connection for node:3 2026-11-03T04:30:26.590029Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T04:30:26.590087Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T04:30:30.170054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:31:13.959372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T04:31:21.952Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 333 89 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "c0ffce77-68dd-9733-9ecf-f34626e1365b" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.232:8000" outbound|54321||e2e-prio-pool-edfabb23-inference-pool-ip-ca68813e.llm.svc.cluster.local 10.132.0.134:46572 10.132.0.134:443 10.132.0.10:36802 - v1-model-routing [2026-11-03T04:31:22.754Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 348 62 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "bab8349c-df47-4468-85a6-5e9370d6cc3c" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.232:8000" outbound|54321||e2e-prio-pool-edfabb23-inference-pool-ip-ca68813e.llm.svc.cluster.local 10.132.0.134:46578 10.132.0.134:443 10.132.0.10:36806 - v1-model-routing 2026-11-03T04:31:41.112289Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T04:31:41.469677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:31:46.473762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:32:04.328197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:34:48.750789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T04:34:48.750825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T04:34:48.750839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T04:34:48.750844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T04:34:48.627Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 123 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "da1e66c2-719c-4a0d-8954-8c2deab524f0" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.134:33936 10.132.0.134:443 10.132.0.10:51268 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T04:35:01.036901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:35:27.123397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:35:51.779709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:36:07.870253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:36:16.996587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:36:23.889655Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:36:33.829136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:36:38.566090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T04:36:42.625Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 74 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "67864997-8326-4a38-85eb-7908efe7ff27" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.134:45016 10.132.0.134:443 10.132.0.10:49388 - v1-completions-path 2026-11-03T04:36:58.486897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T04:37:16.377Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 81 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "700e4bd0-e960-4529-a56e-25ab22fa321b" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.134:59540 10.132.0.134:443 10.132.0.10:52632 - v1-completions-path 2026-11-03T04:37:39.846394Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T04:37:47.619808Z info ads ADS: new connection for node:4 2026-11-03T04:37:47.624834Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T04:37:47.624976Z info cache read certificate from file resource=file-root:system 2026-11-03T04:37:51.521953Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:37:52.998800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:38:19.689646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T04:38:19.689675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T04:38:19.689684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T04:38:19.689688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T04:38:19.689845Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T04:38:19.560Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 128 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "3f1283e6-7c49-41b5-a6d5-59a96960810f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.134:49600 10.132.0.134:443 10.132.0.10:35694 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T04:39:28.622678Z info ads ADS: "" 4 terminated 2026-11-03T04:39:28.666770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:39:31.341938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:39:42.593487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:40:01.572165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:40:06.451104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:40:27.738806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:40:44.645755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:40:51.609925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:40:51.609972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:40:51.609994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:40:51.610002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T04:40:51.493Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 116 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "41952061-d288-4999-87b9-55695d97755a" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.134:56186 10.132.0.134:443 10.132.0.10:42206 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T04:40:53.412185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T04:40:53.406Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e4dfdb0b-584e-4553-aa5d-6ad837ab48f4" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.134:40612 10.132.0.134:443 10.132.0.10:50506 - v1-completions-path [2026-11-03T04:40:56.686Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e52e57ad-3ed9-471a-b307-34068f3243cf" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.134:45016 10.132.0.134:443 10.132.0.10:50526 - v1-completions-path 2026-11-03T04:41:16.044197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:41:27.055563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:41:31.837815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:42:01.976770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:42:06.827244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:42:10.035505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:42:10.035546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:42:10.035563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T04:42:10.035568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T04:42:09.681Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 354 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e16e34fb-3f1b-41cb-9d0e-1623832b2250" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.134:45930 10.132.0.134:443 10.132.0.10:38766 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T04:42:21.078557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:42:30.432244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:42:38.763589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:42:48.337325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:42:58.429121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:43:15.732455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:43:22.166285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:43:53.875397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:44:17.125901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:44:28.469393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:44:47.302726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:44:55.551370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:48:49.670417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:49:07.049979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:49:11.751768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:49:25.510234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:49:42.064686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:49:47.192026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:49:53.693930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:49:53.693969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:49:53.693986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:49:53.693991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T04:49:53.570Z] "DELETE /v1/api-keys/56886ce1-6934-4fc7-9730-8c2572269bc2 HTTP/1.1" 200 - via_upstream - "-" 0 369 123 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "ac48a8d7-67e5-45a0-8dd7-fb19354d1fce" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.132.0.151:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.134:33800 10.132.0.134:443 10.132.0.10:54196 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T04:50:07.472889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:50:18.223046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:50:24.725503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:50:53.913126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:51:00.488433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:51:06.919111Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:51:25.414182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:51:25.414226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T04:51:25.414248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T04:51:25.414255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T04:51:25.293Z] "DELETE /v1/api-keys/ccbbab0f-566d-4b44-a45b-d3d5d4222fb2 HTTP/1.1" 200 - via_upstream - "-" 0 365 121 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "68957e0f-72b8-49d6-9aa2-09c669d86c06" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.134.0.243:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.134:38348 10.132.0.134:443 10.132.0.10:44048 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T04:51:39.020700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:51:49.695006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:51:56.673715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:52:03.084434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:52:14.969380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T04:52:22.930Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "b92347b5-38e8-4794-a035-9d67f7aad82b" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.134:45016 10.132.0.134:443 10.132.0.10:34060 - v1-completions-path [2026-11-03T04:52:23.300Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "c8122e5a-6523-4c6e-b810-f4730331ce01" "maas.apps.bbf32bbb4c5c76878149.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.134:45016 10.132.0.134:443 10.132.0.10:33566 - v1-completions-path 2026-11-03T04:52:38.397364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:52:49.249260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:52:52.613342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:53:12.376902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:53:18.792141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:53:42.621097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:54:02.808636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:54:13.481905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:54:26.095746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:54:45.996243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:54:56.693023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:55:07.476684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:55:18.360389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:55:28.945471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T04:55:39.731896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8