2026-11-03T00:19:41.416114Z info FLAG: --concurrency="0" 2026-11-03T00:19:41.416135Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T00:19:41.416139Z info FLAG: --help="false" 2026-11-03T00:19:41.416142Z info FLAG: --log_as_json="false" 2026-11-03T00:19:41.416144Z info FLAG: --log_caller="" 2026-11-03T00:19:41.416145Z info FLAG: --log_output_level="default:info" 2026-11-03T00:19:41.416147Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T00:19:41.416152Z info FLAG: --log_target="[stdout]" 2026-11-03T00:19:41.416155Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T00:19:41.416156Z info FLAG: --outlierLogPath="" 2026-11-03T00:19:41.416158Z info FLAG: --profiling="true" 2026-11-03T00:19:41.416160Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T00:19:41.416162Z info FLAG: --proxyLogLevel="warning" 2026-11-03T00:19:41.416164Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T00:19:41.416166Z info FLAG: --stsPort="0" 2026-11-03T00:19:41.416191Z info FLAG: --templateFile="" 2026-11-03T00:19:41.416194Z info FLAG: --tokenManagerPlugin="" 2026-11-03T00:19:41.416198Z info FLAG: --vklog="0" 2026-11-03T00:19:41.416202Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T00:19:41.416339Z info Proxy role ips=[10.133.1.52] type=router id=maas-default-gateway-openshift-default-694db55c87-k2dss.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T00:19:41.416385Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T00:19:41.417412Z info cpu limit detected as 2, setting concurrency 2026-11-03T00:19:41.418020Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T00:19:41.418056Z info JWT policy is third-party-jwt 2026-11-03T00:19:41.418061Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T00:19:41.420747Z info Starting default Istio SDS Server 2026-11-03T00:19:41.420770Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T00:19:41.420735Z info Opening status port 15020 2026-11-03T00:19:41.420794Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T00:19:41.421560Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T00:19:41.422207Z info sds Starting SDS grpc server 2026-11-03T00:19:41.422227Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T00:19:41.423278Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T00:19:41.424324Z info Starting proxy agent 2026-11-03T00:19:41.424362Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T00:19:41.489534Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T00:19:41.553031Z info cache generated new workload certificate resourceName=default latency=130.706785ms ttl=23h59m59.446972791s 2026-11-03T00:19:41.553072Z info cache Root cert has changed, start rotating root cert 2026-11-03T00:19:41.553117Z info cache returned workload trust anchor from cache ttl=23h59m59.446884697s 2026-11-03T00:19:41.667556Z info ads ADS: new connection for node:1 2026-11-03T00:19:41.667621Z info cache returned workload certificate from cache ttl=23h59m59.332380889s 2026-11-03T00:19:41.667920Z info ads ADS: new connection for node:2 2026-11-03T00:19:41.668000Z info cache returned workload trust anchor from cache ttl=23h59m59.332001215s 2026-11-03T00:19:41.752529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:19:49.739689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:19:50.905787Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T00:19:52.008068Z info Readiness succeeded in 10.594270979s 2026-11-03T00:19:52.008570Z info Envoy proxy is ready 2026-11-03T00:20:20.575334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:20:23.915Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 147 412 98 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "88759b10-a661-4ca1-8129-5a55b3c23bfb" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:43216 10.133.1.52:443 10.132.0.17:55716 - v1-chat-completions-path [2026-11-03T00:20:26.240Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 64 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "8b0d6b3c-c830-46d6-a1a3-4fefa78c3791" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:43228 10.133.1.52:443 10.132.0.17:55742 - v1-chat-completions-path 2026-11-03T00:20:40.375746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:20:45.300675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:20:48.647279Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T00:20:48.555Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 92 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "bcaaedb2-8c56-4a38-8077-3635956a8646" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:53722 10.133.1.52:443 10.132.0.17:34506 - v1-catch-all-model-routing 2026-11-03T00:20:54.826977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:20:58.340519Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-03T00:20:58.271Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 69 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "2f196c2e-5a6e-4b2f-981e-553b76be83d5" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:47028 10.133.1.52:443 10.132.0.17:59830 - v1-catch-all-path 2026-11-03T00:21:08.702124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:21:18.139376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:21:28.692301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:21:46.678013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:21:48.635740Z info ads ADS: new connection for node:3 2026-11-03T00:21:48.636034Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:21:48.636121Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:21:56.210256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:22:32.556124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:22:35.740Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 327 99 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "3df0f057-259e-4e6e-9b41-02b61ab77a03" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.208:8000" outbound|54321||e2e-prio-pool-37a87c71-inference-pool-ip-ac6ea8b0.llm.svc.cluster.local 10.133.1.52:48954 10.133.1.52:443 10.132.0.17:43918 - v1-model-routing [2026-11-03T00:22:38.908Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 343 63 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "269ba518-682b-4248-a684-bf3e6ac09056" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.208:8000" outbound|54321||e2e-prio-pool-37a87c71-inference-pool-ip-ac6ea8b0.llm.svc.cluster.local 10.133.1.52:48970 10.133.1.52:443 10.132.0.17:41672 - v1-model-routing [2026-11-03T00:22:54.230Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 36 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "dc6e69df-6ed5-4bd5-97f3-63d477eec09f" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-37a87c71-inference-pool-ip-ac6ea8b0.llm.svc.cluster.local - 10.133.1.52:443 10.132.0.17:40134 - v1-model-routing 2026-11-03T00:22:56.512758Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T00:22:56.559003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:01.419750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:17.911716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:25:57.246496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:26:28.529143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:26:59.136840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:27:14.591970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:27:31.578276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:27:44.095013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:27:49.020784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:27:52.567617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-03T00:27:52.512Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 73 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "11e70c64-34b6-4be7-aaa6-69efe8f80bf0" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:52000 10.133.1.52:443 10.132.0.17:40508 - v1-completions-path [2026-11-03T00:27:52.783Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "146e6574-c3e3-4497-8a64-0d9b31aeeee5" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:52000 10.133.1.52:443 10.132.0.17:40516 - v1-completions-path 2026-11-03T00:28:09.494282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:28:56.875513Z info ads ADS: new connection for node:4 2026-11-03T00:28:56.879587Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T00:28:56.879684Z info cache read certificate from file resource=file-root:system 2026-11-03T00:29:00.788394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:02.002814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:30:21.499954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T00:30:21.499992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T00:30:21.500008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T00:30:21.500013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T00:30:21.500235Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T00:30:21.372Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1711 127 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "76814aeb-c1b1-4b48-85eb-f37f4ef8dc84" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.52:41616 10.133.1.52:443 10.132.0.17:52750 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:42.287079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T00:30:42.287114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T00:30:42.287126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T00:30:42.287131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T00:30:42.287353Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T00:30:42.175Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 111 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "94737290-7006-4555-9808-8ff3477f8f3f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.52:41616 10.133.1.52:443 10.132.0.17:33506 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:57.582603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:30:57.621742Z info ads ADS: "" 4 terminated 2026-11-03T00:31:00.264459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:31:10.941766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:31:15.797606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T00:31:15.741Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "805f83ec-ccca-4edc-a6ab-6d3847deadae" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.52:443 10.132.0.17:44338 - v1-completions-path 2026-11-03T00:31:29.425224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:31:34.056356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:31:52.951Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 84 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e9f4568a-8e3b-46c0-8218-480015e0e658" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:40458 10.133.1.52:443 10.132.0.17:51696 - v1-completions-path 2026-11-03T00:31:58.156052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:32:11.365783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:32:42.231735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:32:52.966295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:32:59.427878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:27.782011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:32.340506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:45.669824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:52.288464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:06.766319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:11.441553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:24.974463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:38.388159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:44.389875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:34:47.190Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 65 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "5c0ebac9-b752-46cd-92d7-2404b895b9e6" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:56362 10.133.1.52:443 10.132.0.17:59908 - v1-completions-path 2026-11-03T00:35:02.768825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:08.445708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:10.528881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:35:10.528923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:35:10.528940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:35:10.528946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:35:10.414Z] "DELETE /v1/api-keys/f6aa0053-88c9-4aa9-abbb-9984dea08679 HTTP/1.1" 200 - via_upstream - "-" 0 375 114 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "0f7bccf3-5304-4c25-b731-04a05289b2b0" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.52:43654 10.133.1.52:443 10.132.0.17:58580 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:35:19.894204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:46.374349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:57.056901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:15.725952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:23.468343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:39:15.698Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 45 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "7b449a52-0061-4bed-a9dd-eae58e8e823d" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.52:443 10.132.0.17:53604 - v1-completions-path 2026-11-03T00:39:20.110935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:40:48.570670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:41:05.915104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:41:10.731764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:41:24.037358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:41:39.844786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:41:44.758785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:41:51.003015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T00:41:51.003063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T00:41:51.003087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T00:41:51.003093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T00:41:50.887Z] "DELETE /v1/api-keys/faee18c0-fcec-49f1-a0ff-755e3bbf3067 HTTP/1.1" 200 - via_upstream - "-" 0 369 115 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "a9d6ec09-77ca-4c28-904e-b8b881e42f12" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.243:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.52:50424 10.133.1.52:443 10.132.0.17:54812 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:42:04.685243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:15.509652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:21.798388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:42:34.955Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 70 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e0a32998-9fcf-4255-8126-53f0e4dd9b7e" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:59684 10.133.1.52:443 10.132.0.17:49650 - v1-completions-path 2026-11-03T00:42:37.040450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:42:37.040491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:42:37.040506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:42:37.040511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:42:36.931Z] "DELETE /v1/api-keys/ef8efae7-3be1-4706-b73a-2d2b0ef26ca8 HTTP/1.1" 200 - via_upstream - "-" 0 365 108 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "766dff8e-6d6d-4358-88c6-568255966996" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.243:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.52:53824 10.133.1.52:443 10.132.0.17:49652 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:42:51.000156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:57.453159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:03.557396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:43:17.044Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "4fd75def-0681-4f4f-af3b-e1f08e7d3206" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:59684 10.133.1.52:443 10.132.0.17:60602 - v1-completions-path [2026-11-03T00:43:19.190Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f7c584d8-39d8-483c-ba8c-603b90b99bb5" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:59684 10.133.1.52:443 10.132.0.17:43948 - v1-completions-path 2026-11-03T00:43:35.706055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:46.303735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:52.814284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:58.771932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:44:07.432Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "33a9e418-cef4-4257-8dc4-da557f54600a" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:52000 10.133.1.52:443 10.132.0.17:58710 - v1-completions-path 2026-11-03T00:44:11.090049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:34.495014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:45.122007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:50.020214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:08.387286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:15.378155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:24.770379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:45.121844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:57.791422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:17.975056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:29.012353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:39.919653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:50.600806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:01.368450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:12.157398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:22.933218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:33.546026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:47:40.730Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 76 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "3c88d1a4-2fe5-431e-b6a8-408520508fe8" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.52:40458 10.133.1.52:443 10.132.0.17:53378 - v1-completions-path