2026-11-01T00:01:07.700242Z info FLAG: --concurrency="0" 2026-11-01T00:01:07.700262Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T00:01:07.700267Z info FLAG: --help="false" 2026-11-01T00:01:07.700271Z info FLAG: --log_as_json="false" 2026-11-01T00:01:07.700274Z info FLAG: --log_caller="" 2026-11-01T00:01:07.700277Z info FLAG: --log_output_level="default:info" 2026-11-01T00:01:07.700280Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T00:01:07.700285Z info FLAG: --log_target="[stdout]" 2026-11-01T00:01:07.700288Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T00:01:07.700290Z info FLAG: --outlierLogPath="" 2026-11-01T00:01:07.700292Z info FLAG: --profiling="true" 2026-11-01T00:01:07.700294Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T00:01:07.700296Z info FLAG: --proxyLogLevel="warning" 2026-11-01T00:01:07.700298Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T00:01:07.700300Z info FLAG: --stsPort="0" 2026-11-01T00:01:07.700303Z info FLAG: --templateFile="" 2026-11-01T00:01:07.700304Z info FLAG: --tokenManagerPlugin="" 2026-11-01T00:01:07.700307Z info FLAG: --vklog="0" 2026-11-01T00:01:07.700309Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T00:01:07.700467Z info Proxy role ips=[10.132.1.23] type=router id=maas-default-gateway-openshift-default-6cc458d887-tpbss.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T00:01:07.700522Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T00:01:07.701596Z info cpu limit detected as 2, setting concurrency 2026-11-01T00:01:07.701835Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T00:01:07.701847Z info JWT policy is third-party-jwt 2026-11-01T00:01:07.701850Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T00:01:07.703466Z info Starting default Istio SDS Server 2026-11-01T00:01:07.703488Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T00:01:07.703506Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T00:01:07.703872Z info Opening status port 15020 2026-11-01T00:01:07.704988Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T00:01:07.706509Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T00:01:07.707458Z info Starting proxy agent 2026-11-01T00:01:07.707529Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T00:01:07.715995Z info sds Starting SDS grpc server 2026-11-01T00:01:07.716014Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T00:01:07.773414Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T00:01:07.816034Z info cache generated new workload certificate resourceName=default latency=111.338385ms ttl=23h59m59.18397164s 2026-11-01T00:01:07.816077Z info cache Root cert has changed, start rotating root cert 2026-11-01T00:01:07.816120Z info cache returned workload trust anchor from cache ttl=23h59m59.183881161s 2026-11-01T00:01:08.011609Z info ads ADS: new connection for node:1 2026-11-01T00:01:08.019623Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T00:01:08.019702Z info cache read certificate from file resource=file-root:system 2026-11-01T00:01:08.057175Z info ads ADS: new connection for node:2 2026-11-01T00:01:08.057265Z info cache returned workload certificate from cache ttl=23h59m58.942738304s 2026-11-01T00:01:08.058938Z info ads ADS: new connection for node:3 2026-11-01T00:01:08.059128Z info cache returned workload trust anchor from cache ttl=23h59m58.940875745s 2026-11-01T00:01:08.182220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:01:16.633549Z info Readiness succeeded in 8.935849047s 2026-11-01T00:01:16.634018Z info Envoy proxy is ready 2026-11-01T00:01:35.410366Z info ads ADS: new connection for node:4 2026-11-01T00:01:35.410620Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T00:01:35.410680Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T00:01:38.586443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:01:57.778399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:02:20.587725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:06:06.463126Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T00:06:08.414847Z info ads ADS: "" 1 terminated with stream closed 2026-11-01T00:13:05.243533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:14:15.833740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:17:08.937168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:19:28.750465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:28:22.284299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:28:22.284339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:28:22.284354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:28:22.284359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T00:28:22.171Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 112 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4373a8eb-6869-4dba-9d52-c03637be0450" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.23:48706 10.132.1.23:443 10.132.0.9:55074 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:28:26.655091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:28:49.821387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:24.025494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:29:27.079Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 189 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "427965e0-0871-4882-b05e-94d1b2ec70d9" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.0.44:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.23:48766 10.132.1.23:443 10.132.0.9:60950 - v1-chat-completions-path 2026-11-01T00:29:39.782816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:42.239022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:48.614266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:51.491005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:29:51.491057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:29:51.491080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:29:51.491089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T00:29:51.410Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 80 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "b7f07b74-d182-4e2c-9d6b-a9dc709d561f" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.23:52434 10.132.1.23:443 10.132.0.9:59614 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:29:55.734013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:30:05.595025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:30:20.401501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:30:31.428554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:30:33.304393Z info ads ADS: new connection for node:5 2026-11-01T00:30:33.304597Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T00:30:34.517825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:31:15.915980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:31:19.901Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 326 85 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "41e80507-7647-4b2a-87c4-bce86b1b55ab" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.1.164:8000" outbound|54321||e2e-prio-pool-ca03fe61-inference-pool-ip-13923081.llm.svc.cluster.local 10.132.1.23:60738 10.132.1.23:443 10.132.0.9:60272 - v1-model-routing 2026-11-01T00:31:24.670266Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T00:31:35.313638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:31:35.333578Z info ads ADS: "" 5 terminated with stream closed 2026-11-01T00:31:37.695996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:31:40.529802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:31:45.619482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:05.271371Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:21.861574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:38.329692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:50.276188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:54.128152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:35:05.888402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:35:09.422103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:35:25.126118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:36:12.263931Z info ads ADS: new connection for node:6 2026-11-01T00:36:12.267647Z info cache read certificate from file resource=file-root:system 2026-11-01T00:36:13.425400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:36:14.988869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:36:36.869352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:36.869386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:36.869397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:36.869402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:36:36.869556Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T00:36:36.758Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 110 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "71aa4824-d72e-4de7-a149-10dcba051d11" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.23:58430 10.132.1.23:443 10.132.0.9:50296 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:37:56.816387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:37:56.945170Z info ads ADS: "" 6 terminated 2026-11-01T00:37:58.323011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:38:00.179112Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T00:38:00.179135Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T00:38:00.179138Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T00:38:00.179142Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-01T00:38:00.144Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 34 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "8e33a6c3-d700-4c70-b11b-ea25d3149eec" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.23:443 10.132.0.9:35880 - v1-completions-path 2026-11-01T00:38:05.089047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:38:07.785957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T00:38:07.703Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 83 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e0f1d88f-be23-48dc-865b-3dca1859aa0f" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.23:55546 10.132.1.23:443 10.132.0.9:57376 - v1-completions-path [2026-11-01T00:38:08.288Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "09f79f83-a6da-4f0c-8fe2-f51ec56e87b6" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.23:55558 10.132.1.23:443 10.132.0.9:57382 - v1-completions-path 2026-11-01T00:38:20.706601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:38:25.267937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:38:28.602904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:38:28.602949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:38:28.602968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:38:28.602975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:38:28.545Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "8bcd82e3-f62a-437b-a3b0-889307eacb6d" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.23:55558 10.132.1.23:443 10.132.0.9:57104 - v1-catch-all-path 2026-11-01T00:38:40.520154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:38:56.594401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:20.011342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:30.311548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:34.889761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:39:38.974Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 56 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "01cc4d8b-abf1-4139-9223-b2ced460c9c1" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.23:55546 10.132.1.23:443 10.132.0.9:48886 - v1-completions-path 2026-11-01T00:39:51.839582Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:54.181471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:01.267224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:13.195474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:18.414531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:26.730251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:31.981722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:50.288195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:53.272882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:41:10.191Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 32 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e1a82b19-bb58-474c-8169-868402445635" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.23:443 10.132.0.9:54438 - v1-completions-path 2026-11-01T00:41:17.135550Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:41:35.088446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:41:45.370466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:45:26.179070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:45:41.594394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:45:43.852529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:45:44.356Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 121 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "faa5640d-e7a1-41bc-9491-d227f2e797f5" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.23:34306 10.132.1.23:443 10.132.0.9:52494 - v1-completions-path 2026-11-01T00:45:50.991080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:10.804857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:14.376822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:29.965981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:40.362544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:45.461478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:50.366661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-01T00:46:50.437566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:46:50.437600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:46:50.437616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:46:50.437621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:46:50.194Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4fa82e99-d397-44fc-b333-1378393134ce" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.23:443 10.132.0.9:53464 - v1-completions-path [2026-11-01T00:46:50.360Z] "DELETE /v1/api-keys/8a0d027f-0806-44da-b02b-ad9d0d0b380a HTTP/1.1" 200 - via_upstream - "-" 0 365 77 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1c9ff48a-3202-46dc-93f4-5afa15b083ef" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.1.112:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.23:59664 10.132.1.23:443 10.132.0.9:53468 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:47:02.488493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:06.938850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:10.457752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:47:17.041Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3d9a8e9d-58d3-4fc1-b330-948a13fdfac7" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.23:55546 10.132.1.23:443 10.132.0.9:48880 - v1-completions-path [2026-11-01T00:47:19.326Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 71 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "0a2454b4-e18e-4b19-91ab-172c48089679" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.23:55558 10.132.1.23:443 10.132.0.9:48896 - v1-completions-path 2026-11-01T00:47:33.147676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:43.468236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:47.954100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:51.383856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:56.282250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:02.848290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:48:02.848328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:48:02.848344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:48:02.848350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:48:02.769Z] "DELETE /v1/api-keys/c4416158-90a0-4d24-9641-d13e3b01de44 HTTP/1.1" 200 - via_upstream - "-" 0 367 78 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "094d9fd2-c513-412f-b299-5da8f43f7f67" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.180:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.23:45984 10.132.1.23:443 10.132.0.9:59498 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:48:14.804471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:25.105948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:27.319437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:36.936281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:40.479792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:58.386414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:00.594704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:19.062347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:29.495670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:36.844380Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-01T00:49:40.026839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:50.301784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:00.669899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:10.992513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:21.400732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:31.703255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:42.033037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:52.361621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8