2026-11-04T00:39:44.667942Z info FLAG: --concurrency="0" 2026-11-04T00:39:44.668090Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T00:39:44.668104Z info FLAG: --help="false" 2026-11-04T00:39:44.668107Z info FLAG: --log_as_json="false" 2026-11-04T00:39:44.668111Z info FLAG: --log_caller="" 2026-11-04T00:39:44.668114Z info FLAG: --log_output_level="default:info" 2026-11-04T00:39:44.668117Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T00:39:44.668124Z info FLAG: --log_target="[stdout]" 2026-11-04T00:39:44.668128Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T00:39:44.668132Z info FLAG: --outlierLogPath="" 2026-11-04T00:39:44.668136Z info FLAG: --profiling="true" 2026-11-04T00:39:44.668139Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T00:39:44.668143Z info FLAG: --proxyLogLevel="warning" 2026-11-04T00:39:44.668146Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T00:39:44.668151Z info FLAG: --stsPort="0" 2026-11-04T00:39:44.668154Z info FLAG: --templateFile="" 2026-11-04T00:39:44.668158Z info FLAG: --tokenManagerPlugin="" 2026-11-04T00:39:44.668170Z info FLAG: --vklog="0" 2026-11-04T00:39:44.668175Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T00:39:44.668375Z info Proxy role ips=[10.134.0.233] type=router id=maas-default-gateway-openshift-default-778b7b5c47-9t5h4.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T00:39:44.668486Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T00:39:44.669697Z info cpu limit detected as 2, setting concurrency 2026-11-04T00:39:44.669945Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T00:39:44.669999Z info JWT policy is third-party-jwt 2026-11-04T00:39:44.670024Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T00:39:44.677187Z info Starting default Istio SDS Server 2026-11-04T00:39:44.677193Z info Opening status port 15020 2026-11-04T00:39:44.677218Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T00:39:44.677258Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T00:39:44.677937Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T00:39:44.678615Z info sds Starting SDS grpc server 2026-11-04T00:39:44.678636Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T00:39:44.679519Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T00:39:44.680533Z info Starting proxy agent 2026-11-04T00:39:44.680572Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T00:39:44.716865Z info cache generated new workload certificate resourceName=default latency=38.135989ms ttl=23h59m59.283138432s 2026-11-04T00:39:44.716896Z info cache Root cert has changed, start rotating root cert 2026-11-04T00:39:44.716926Z info cache returned workload trust anchor from cache ttl=23h59m59.283075104s 2026-11-04T00:39:44.763201Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T00:39:44.906981Z info ads ADS: new connection for node:1 2026-11-04T00:39:44.907163Z info cache returned workload certificate from cache ttl=23h59m59.092838932s 2026-11-04T00:39:44.907962Z info ads ADS: new connection for node:2 2026-11-04T00:39:44.908049Z info cache returned workload trust anchor from cache ttl=23h59m59.091951744s 2026-11-04T00:39:45.001909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:39:54.150661Z info Readiness succeeded in 9.485352193s 2026-11-04T00:39:54.151193Z info Envoy proxy is ready 2026-11-04T00:40:08.872160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T00:40:12.908Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 93 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e1033a8d-ef2b-4248-9d40-1dc485bc17d0" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:41364 10.134.0.233:443 10.132.0.9:58414 - v1-chat-completions-path 2026-11-04T00:40:24.666531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:40:27.500558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:40:33.015577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:40:48.166822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:40:49.882491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:40:52.689972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:40:52.690007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:40:52.690019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T00:40:52.690024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T00:40:52.627Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 62 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "9e850f54-c657-47de-a67a-f7821a0cf369" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.233:44188 10.134.0.233:443 10.132.0.9:56404 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T00:40:59.184789Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-04T00:41:04.397085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:41:15.406163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:41:17.694269Z info ads ADS: new connection for node:3 2026-11-04T00:41:17.694574Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T00:41:17.694612Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T00:41:19.804077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:41:59.509505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:42:28.647698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:42:38.757523Z info ads ADS: "" 3 terminated 2026-11-04T00:42:40.721578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:42:43.180169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:42:54.390692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:45:23.150200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:45:39.500921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:45:54.666509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:46:06.404982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:46:10.120119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:46:29.186156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:46:31.584479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:46:46.842570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T00:47:26.229Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 83 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "d5ee1f89-fba1-4e31-962c-743ff9741e71" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.28:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:41976 10.134.0.233:443 10.132.0.9:52608 - v1-completions-path 2026-11-04T00:48:02.101500Z info ads ADS: new connection for node:4 2026-11-04T00:48:02.105737Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T00:48:02.105794Z info cache read certificate from file resource=file-root:system 2026-11-04T00:48:02.755505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:48:04.804068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:48:32.692772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:48:32.692809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:48:32.692823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T00:48:32.692829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:48:32.693006Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-04T00:48:32.547Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1543 145 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "040a98a8-4f32-482e-9ff5-8bfd4432a45f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.233:34578 10.134.0.233:443 10.132.0.9:48644 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T00:48:47.995834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:48:47.995866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:48:47.995876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T00:48:47.995880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:48:47.996029Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T00:48:47.869Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1542 126 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "40bd3218-942a-44ed-b296-b4b0638daf24" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.233:48092 10.134.0.233:443 10.132.0.9:40878 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T00:48:56.628346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T00:48:56.628797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:48:56.628824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:48:56.628838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T00:48:56.628843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:48:56.629000Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T00:48:56.535Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1542 93 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "12fb00ba-5c6b-4c05-9a39-00a74ebd51a6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.233:48092 10.134.0.233:443 10.132.0.9:37444 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T00:48:58.789136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:48:58.789167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:48:58.789177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:48:58.789182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T00:48:58.789322Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-04T00:48:58.694Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1542 95 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "2eb238ec-f7e3-4fae-b07a-2a6013abff27" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.233:34578 10.134.0.233:443 10.132.0.9:37454 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T00:49:05.255561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-04T00:49:05.292195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:49:05.292219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:49:05.292227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:49:05.292232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T00:49:05.292364Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-04T00:49:05.200Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1542 92 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "ed60355f-bb68-4afb-bc76-3e3098db1433" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.233:34578 10.134.0.233:443 10.132.0.9:33142 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T00:49:40.489565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:49:40.640651Z info ads ADS: "" 4 terminated 2026-11-04T00:49:41.049756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:49:43.835740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:49:45.918741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:50:01.225134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:50:03.074033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T00:50:05.965Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 289 74 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "c6f2683e-de6f-4565-bdd4-e520876d9aff" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:52664 10.134.0.233:443 10.132.0.9:60762 - v1-completions-path 2026-11-04T00:50:18.156198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:50:19.878044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:50:22.804909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:50:31.090115Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T00:50:37.587Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e6d9e38f-9bad-40d3-9b08-e3ee6152f87f" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:43868 10.134.0.233:443 10.132.0.9:39704 - v1-completions-path 2026-11-04T00:50:55.705548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:51:05.986863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:51:07.783464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T00:51:13.424Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "77fbcd73-ab33-4e36-a936-245febb0a795" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:52664 10.134.0.233:443 10.132.0.9:36576 - v1-completions-path [2026-11-04T00:51:13.937Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "72de10ea-c770-4f84-9756-ad9e63f5ce43" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:43868 10.134.0.233:443 10.132.0.9:36586 - v1-completions-path 2026-11-04T00:51:26.793846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:51:28.491111Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:51:34.164594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:51:45.136363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:51:58.986291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:52:00.753863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:52:06.327960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:52:24.329752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:52:35.078437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:52:49.423967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:52:51.183085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:52:57.078130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:53:22.017302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:53:32.303991Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:54:19.321252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:54:22.203111Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:56:56.618279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:56:56.618312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T00:56:56.618325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T00:56:56.618330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T00:56:56.553Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 64 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "060cec9d-722a-4c32-a752-41f8029f00de" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.233:36980 10.134.0.233:443 10.132.0.9:56884 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T00:57:08.786487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:57:11.628514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:58:31.900229Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T00:58:43.520Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 295 79 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "8bfcf1cf-ca73-48cf-a668-b3c2b81a17f7" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:56700 10.134.0.233:443 10.132.0.9:44586 - v1-completions-path 2026-11-04T00:58:55.947954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:58:57.728699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:59:00.553212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:59:00.553265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T00:59:00.553287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T00:59:00.553294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-04T00:59:00.457Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 95 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "bb3d745d-e8c3-48d0-84e6-ac097096d390" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.233:34356 10.134.0.233:443 10.132.0.9:42896 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T00:59:00.976013Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-04T00:59:00.976038Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-04T00:59:00.976042Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-04T00:59:00.976047Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-04T00:59:00.940Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 35 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "076f3945-f492-443f-b106-3922c9001fb8" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.233:443 10.132.0.9:42908 - v1-completions-path 2026-11-04T00:59:03.613987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:59:22.447480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:59:26.459757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T00:59:29.955Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 61 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "b7c49c78-ebad-4620-bbf1-3e25b2c18cf1" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:52664 10.134.0.233:443 10.132.0.9:55412 - v1-completions-path 2026-11-04T00:59:42.010085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T00:59:52.418818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:00:04.863596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:00:09.537Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "866d23a8-cf3a-4e17-acc2-8dfd92d98927" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:43868 10.134.0.233:443 10.132.0.9:47668 - v1-completions-path 2026-11-04T01:00:22.473555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:00:34.504526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:00:38.511112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:00:42.606Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "2a2a74ea-4fc1-4418-9e2c-236b64e67599" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:52664 10.134.0.233:443 10.132.0.9:50712 - v1-completions-path [2026-11-04T01:00:42.728Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e60b7051-cc68-41d0-8979-8cbb21869b94" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:52664 10.134.0.233:443 10.132.0.9:50726 - v1-completions-path [2026-11-04T01:00:46.724Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "5a9de1fd-2812-4dac-b03e-219983e6a17c" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:52664 10.134.0.233:443 10.132.0.9:50732 - v1-completions-path 2026-11-04T01:01:00.060222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:01:10.215117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:01:12.459705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:01:15.612120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:01:21.835710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:01:24.905Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 75 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "26922693-1e83-4ad3-b0e8-a7abad7ccafb" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:43868 10.134.0.233:443 10.132.0.9:38050 - v1-completions-path [2026-11-04T01:01:25.143Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "852b2a52-1108-49a9-9a55-f1d6696bce72" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:52664 10.134.0.233:443 10.132.0.9:38054 - v1-completions-path 2026-11-04T01:01:38.302843Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:01:48.393625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:01:50.109869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:02:10.480574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:02:13.475663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:02:16.770311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:02:32.780509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:02:52.723402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:03:02.952585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:03:13.175922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:03:23.468001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:03:33.643659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:03:44.003124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:03:54.109408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:04:04.389415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:04:14.611728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:04:24.786794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T01:04:37.897Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 60 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "8f94c852-e440-48f4-86dd-b8e7363ba6f8" "maas.apps.b4341b0d6c25eae239a7.prod.konflux-ocp-ci.dev" "10.134.0.28:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.233:41976 10.134.0.233:443 10.132.0.9:36686 - v1-completions-path