2026-10-30T06:36:30.891579Z info FLAG: --concurrency="0" 2026-10-30T06:36:30.891596Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T06:36:30.891600Z info FLAG: --help="false" 2026-10-30T06:36:30.891603Z info FLAG: --log_as_json="false" 2026-10-30T06:36:30.891605Z info FLAG: --log_caller="" 2026-10-30T06:36:30.891607Z info FLAG: --log_output_level="default:info" 2026-10-30T06:36:30.891609Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T06:36:30.891613Z info FLAG: --log_target="[stdout]" 2026-10-30T06:36:30.891615Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T06:36:30.891617Z info FLAG: --outlierLogPath="" 2026-10-30T06:36:30.891619Z info FLAG: --profiling="true" 2026-10-30T06:36:30.891621Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T06:36:30.891624Z info FLAG: --proxyLogLevel="warning" 2026-10-30T06:36:30.891626Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T06:36:30.891628Z info FLAG: --stsPort="0" 2026-10-30T06:36:30.891630Z info FLAG: --templateFile="" 2026-10-30T06:36:30.891632Z info FLAG: --tokenManagerPlugin="" 2026-10-30T06:36:30.891635Z info FLAG: --vklog="0" 2026-10-30T06:36:30.891637Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T06:36:30.891772Z info Proxy role ips=[10.134.0.21] type=router id=maas-default-gateway-openshift-default-59f957fdd7-rzh4v.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T06:36:30.891819Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T06:36:30.892854Z info cpu limit detected as 2, setting concurrency 2026-10-30T06:36:30.893063Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T06:36:30.893074Z info JWT policy is third-party-jwt 2026-10-30T06:36:30.893077Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T06:36:30.894318Z info Starting default Istio SDS Server 2026-10-30T06:36:30.894352Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T06:36:30.894379Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T06:36:30.894915Z info Opening status port 15020 2026-10-30T06:36:30.895704Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T06:36:30.896365Z info sds Starting SDS grpc server 2026-10-30T06:36:30.896410Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T06:36:30.897134Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T06:36:30.897918Z info Starting proxy agent 2026-10-30T06:36:30.897947Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T06:36:30.958046Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T06:36:30.986719Z info cache generated new workload certificate resourceName=default latency=90.23317ms ttl=23h59m59.013283918s 2026-10-30T06:36:30.986752Z info cache Root cert has changed, start rotating root cert 2026-10-30T06:36:30.986787Z info cache returned workload trust anchor from cache ttl=23h59m59.013213244s 2026-10-30T06:36:31.073371Z info ads ADS: new connection for node:1 2026-10-30T06:36:31.073438Z info cache returned workload certificate from cache ttl=23h59m58.926563841s 2026-10-30T06:36:31.073959Z info ads ADS: new connection for node:2 2026-10-30T06:36:31.074034Z info cache returned workload trust anchor from cache ttl=23h59m58.925967238s 2026-10-30T06:36:31.157002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:36:39.189157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:36:40.134832Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T06:36:40.513198Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T06:36:41.160881Z info Readiness succeeded in 10.272226838s 2026-10-30T06:36:41.161224Z info Envoy proxy is ready 2026-10-30T06:36:42.523967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:36:48.298993Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T06:36:48.217Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 81 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "43c32c6b-444b-4f46-b2f2-ba9b8db6f3c0" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:38110 10.134.0.21:443 10.132.0.20:51496 - v1-catch-all-path 2026-10-30T06:37:00.505949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:37:02.988296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:37:17.850186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:37:28.796354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:37:31.456796Z info ads ADS: new connection for node:3 2026-10-30T06:37:31.457172Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T06:37:31.457250Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T06:37:35.325859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:38:13.211233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:38:18.218Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 356 86 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "bf4a3906-1683-4d7e-b91a-ead54685d58e" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.238:8000" outbound|54321||e2e-prio-pool-da0a2d06-inference-pool-ip-964c2513.llm.svc.cluster.local 10.134.0.21:44778 10.134.0.21:443 10.132.0.20:55234 - v1-model-routing 2026-10-30T06:38:32.327236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:38:32.463029Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T06:38:35.772712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:38:43.715661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:40:05.619251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:40:23.701415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:40:38.616891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:40:50.683293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:40:54.251342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:40:54.251378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:40:54.251392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T06:40:54.251397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:40:54.720326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:40:54.170Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 80 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "19c18191-3f4d-431d-a257-16b4d7d08e16" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:59812 10.134.0.21:443 10.132.0.20:54208 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:41:06.448334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:41:10.316823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:41:30.217256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:42:17.067696Z info ads ADS: new connection for node:4 2026-10-30T06:42:17.072948Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T06:42:17.072996Z info cache read certificate from file resource=file-root:system 2026-10-30T06:42:18.034246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:42:19.766882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:43:33.004165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:43:33.004194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:43:33.004204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:43:33.004208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T06:43:33.004362Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T06:43:32.891Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1726 113 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "df1ab421-3b01-4716-8ff1-299210f75333" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.21:46256 10.134.0.21:443 10.132.0.20:47990 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T06:43:48.387706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:43:48.527125Z info ads ADS: "" 4 terminated with stream closed 2026-10-30T06:43:48.664629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T06:43:48.731044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:43:48.731081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:43:48.731096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T06:43:48.731101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T06:43:48.657Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 73 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "f505f1c3-f2ee-4b04-bbf7-39ccf236b3be" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:45208 10.134.0.21:443 10.132.0.20:59628 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:43:50.116297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:43:57.008974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:44:14.075246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:44:18.940585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:44:36.289Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e5305faa-7b9e-46e7-9ca3-ef6fb7df791d" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:51314 10.134.0.21:443 10.132.0.20:48954 - v1-completions-path 2026-10-30T06:44:39.078348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:44:53.083261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:44:59.488Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ddaaa597-f2b6-4ac4-8ec5-2c36acf62758" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:57808 10.134.0.21:443 10.132.0.20:59002 - v1-completions-path 2026-10-30T06:45:16.418764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:45:26.805000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:45:31.655998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:45:35.385Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ca2d4efd-9f91-4a5c-9b5f-b04bd20daab6" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:48280 10.134.0.21:443 10.132.0.20:50856 - v1-completions-path [2026-10-30T06:45:35.544Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "25fd0850-b700-49c7-83fc-00cc1cb01b9a" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:48280 10.134.0.21:443 10.132.0.20:50862 - v1-completions-path 2026-10-30T06:45:48.118322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:45:50.559539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:46:09.712410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:46:14.621434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:46:30.548481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:46:46.603657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:46:58.141728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:47:01.635270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:47:09.689Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 60 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "714fa142-588f-4b03-aaff-297292fca520" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:51314 10.134.0.21:443 10.132.0.20:51238 - v1-completions-path 2026-10-30T06:47:22.599416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:47:25.535384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:47:37.582620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:47:55.526896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:48:05.812572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:48:25.976626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:48:29.347429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:49:59.663940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:50:03.374879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:51:33.181222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:51:47.861243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:51:50.321149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:51:57.144479Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:51:57.144505Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:51:57.144508Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:51:57.144512Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T06:51:57.111Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 33 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "956a1fdd-680f-40fd-827a-1e86504ce749" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.21:443 10.132.0.20:52752 - v1-completions-path 2026-10-30T06:52:09.185266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:52:21.376958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:52:24.423237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:52:25.059472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T06:52:24.964Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 95 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d56af751-43a8-4377-be74-aca497f54f24" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:48280 10.134.0.21:443 10.132.0.20:44908 - v1-completions-path [2026-10-30T06:52:25.099Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 102 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "97707fd1-4d90-4d4f-a8d6-a194a403e0fb" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:57808 10.134.0.21:443 10.132.0.20:44924 - v1-completions-path 2026-10-30T06:52:40.049554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:52:50.772284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:52:55.527884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:52:59.715916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:52:59.715953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:52:59.715969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T06:52:59.715974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T06:52:59.634Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 81 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d7f38f6f-cce9-43d6-8750-ec143468cd4d" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.169:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:54316 10.134.0.21:443 10.132.0.20:47122 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T06:53:00.549Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 68 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d33a0884-abf1-483d-8dba-9c9b7a0b5a92" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:48280 10.134.0.21:443 10.132.0.20:47128 - v1-completions-path 2026-10-30T06:53:12.982977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:53:17.767358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:53:21.396542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:53:30.636Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "923aaba6-deef-44a7-9630-9ac330b36751" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:48280 10.134.0.21:443 10.132.0.20:58094 - v1-completions-path 2026-10-30T06:53:43.885184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:53:54.107825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:53:58.868962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:54:02.546940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:54:07.309550Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:54:25.696786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:54:36.008142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:54:38.397327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:54:48.265440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:54:52.708868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:55:08.639063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:55:11.164504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:55:29.468134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:55:39.658777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:55:50.145306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:56:00.362659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:56:10.718754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:56:20.973113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:56:31.379661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:56:41.687030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:56:52.106054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:57:02.541504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:57:05.443160Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T06:57:05.443193Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T06:57:05.443196Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T06:57:05.443200Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T06:57:05.421Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 21 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7ae85e78-7c52-478e-96e5-362565401c2e" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.21:443 10.132.0.20:60930 - v1-completions-path [2026-10-30T06:57:11.677Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 68 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "bae8971d-2a41-4e6d-a3c1-ac8aa7672111" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:37930 10.134.0.21:443 10.132.0.20:60950 - v1-completions-path