2026-11-01T05:12:47.521470Z info FLAG: --concurrency="0" 2026-11-01T05:12:47.521489Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T05:12:47.521493Z info FLAG: --help="false" 2026-11-01T05:12:47.521495Z info FLAG: --log_as_json="false" 2026-11-01T05:12:47.521497Z info FLAG: --log_caller="" 2026-11-01T05:12:47.521499Z info FLAG: --log_output_level="default:info" 2026-11-01T05:12:47.521501Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T05:12:47.521506Z info FLAG: --log_target="[stdout]" 2026-11-01T05:12:47.521508Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T05:12:47.521510Z info FLAG: --outlierLogPath="" 2026-11-01T05:12:47.521512Z info FLAG: --profiling="true" 2026-11-01T05:12:47.521514Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T05:12:47.521515Z info FLAG: --proxyLogLevel="warning" 2026-11-01T05:12:47.521518Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T05:12:47.521520Z info FLAG: --stsPort="0" 2026-11-01T05:12:47.521522Z info FLAG: --templateFile="" 2026-11-01T05:12:47.521523Z info FLAG: --tokenManagerPlugin="" 2026-11-01T05:12:47.521526Z info FLAG: --vklog="0" 2026-11-01T05:12:47.521528Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T05:12:47.521702Z info Proxy role ips=[10.132.0.33] type=router id=maas-default-gateway-openshift-default-58d898bd55-ck46t.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T05:12:47.521757Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T05:12:47.523340Z info cpu limit detected as 2, setting concurrency 2026-11-01T05:12:47.523546Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T05:12:47.523558Z info JWT policy is third-party-jwt 2026-11-01T05:12:47.523561Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T05:12:47.525105Z info Starting default Istio SDS Server 2026-11-01T05:12:47.525133Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T05:12:47.525151Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T05:12:47.525556Z info Opening status port 15020 2026-11-01T05:12:47.526167Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T05:12:47.527891Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T05:12:47.529508Z info sds Starting SDS grpc server 2026-11-01T05:12:47.529531Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T05:12:47.530277Z info Starting proxy agent 2026-11-01T05:12:47.530419Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T05:12:47.592613Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T05:12:47.687724Z info cache generated new workload certificate resourceName=default latency=161.687669ms ttl=23h59m59.312282117s 2026-11-01T05:12:47.687776Z info cache Root cert has changed, start rotating root cert 2026-11-01T05:12:47.687838Z info cache returned workload trust anchor from cache ttl=23h59m59.31216313s 2026-11-01T05:12:47.751575Z info ads ADS: new connection for node:1 2026-11-01T05:12:47.751643Z info cache returned workload certificate from cache ttl=23h59m59.248358845s 2026-11-01T05:12:47.751806Z info ads ADS: new connection for node:2 2026-11-01T05:12:47.751871Z info cache returned workload trust anchor from cache ttl=23h59m59.248129645s 2026-11-01T05:12:47.796157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:12:54.194076Z info Readiness succeeded in 6.675130429s 2026-11-01T05:12:54.194420Z info Envoy proxy is ready 2026-11-01T05:13:15.589831Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:13:23.076323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:13:30.019417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:13:37.432455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:13:45.697700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:13:51.364568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T05:14:23.243Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 70 - "44.212.242.249,10.132.0.14" "curl/7.76.1" "f47b05e5-1d49-4409-af37-ad52fb060cc0" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:59976 - v1-model-routing 2026-11-01T05:14:50.585312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:50.585350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:50.585364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T05:14:50.585369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T05:14:50.460Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 125 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c09282ba-2a29-45b5-a109-db9c3fa25670" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:32990 10.132.0.33:443 10.132.0.14:41520 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T05:14:51.132896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:51.132943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:51.132966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:51.132973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T05:14:51.022Z] "DELETE /v1/api-keys/1ee64c4c-49a3-4c4b-8c1f-2e1a7e2be273 HTTP/1.1" 200 - via_upstream - "-" 0 370 110 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e2fcf3f5-4024-40e4-8825-29c17bb45814" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:32990 10.132.0.33:443 10.132.0.14:41522 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T05:14:52.029775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:14:52.029859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:14:52.029878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:14:52.029885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T05:14:52.614927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:14:52.614960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:14:52.614974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:14:52.614979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T05:14:51.894Z] "DELETE /v1/api-keys/80a0b65a-d631-41e8-9c07-ce793ad14b09 HTTP/1.1" 200 - via_upstream - "-" 0 321 135 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e829639d-7fe3-4482-9a1a-216884b852ef" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:33004 10.132.0.33:443 10.132.0.14:41542 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T05:14:52.503Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 111 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e9860410-3acd-4d2e-aaa9-1e7d1e8633ff" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:33004 10.132.0.33:443 10.132.0.14:41548 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T05:14:54.334739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:54.334774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:54.334814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:54.334819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T05:14:53.932Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 87 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "1d058cbf-12e9-45f9-a1c1-a8dbf42ef60a" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.33:443 10.132.0.14:41558 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T05:14:54.222Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 112 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "63719b5e-435f-44cf-bd93-2784ed699783" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:32990 10.132.0.33:443 10.132.0.14:41570 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T05:14:56.397733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:56.397769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:56.397801Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:14:56.397808Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T05:14:56.291Z] "DELETE /v1/api-keys/32d7787e-7cf4-4fa7-b0a4-987dc13e584a HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e94a2716-8b70-4857-86d5-86d4654f99b3" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:32990 10.132.0.33:443 10.132.0.14:41582 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T05:15:01.019358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:15:01.019394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:15:01.019401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-01T05:15:01.019415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:15:01.019419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T05:15:00.908Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 110 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "a9812931-f122-4013-b060-1612488e82ec" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:32990 10.132.0.33:443 10.132.0.14:58440 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T05:15:20.927646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:15:39.667487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T05:15:45.932Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 11 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "90d211eb-aeda-421c-a5eb-f9724b6f4a09" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.33:443 10.132.0.14:54952 - - 2026-11-01T05:20:07.619511Z info ads ADS: new connection for node:3 2026-11-01T05:20:07.626189Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T05:20:07.626364Z info cache read certificate from file resource=file-root:system [2026-11-01T05:23:32.586Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 331 83 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d9011e0f-d1e4-4623-b7ad-0f4416c273a6" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:51058 10.132.0.33:443 10.132.0.14:57546 - v1-chat-completions-path 2026-11-01T05:24:41.281546Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:25:28.836985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:35:31.405955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:36:07.006070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:36:11.392968Z info ads ADS: new connection for node:4 2026-11-01T05:36:11.393180Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T05:36:11.393211Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T05:37:29.356496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:41:19.039021Z info ads ADS: "" 4 terminated 2026-11-01T05:44:22.002604Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T05:45:18.204489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:45:26.730864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:45:47.567932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:46:15.619854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:46:20.099180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:46:23.995478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:46:33.252310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:46:35.538624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:46:36.833713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:46:41.061481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:46:45.114711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:47:32.258625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:47:43.287823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:47:56.937410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:48:00.915514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:00.915544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:00.915552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:00.915556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T05:48:00.915701Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T05:48:00.789Z] "POST /anything/e2e-rt-sw-2b6908-client HTTP/1.1" 200 - via_upstream - "-" 124 1762 126 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "1f5ea6f3-fad1-4328-8452-ea6add9a043d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:59248 10.132.0.33:443 10.132.0.14:38182 - llm.external-model-e2e-rt-sw-2b6908-8999a080558e.0 2026-11-01T05:48:12.871901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:48:18.382464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-01T05:48:18.388361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:18.388395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:18.388411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T05:48:18.388417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:18.388626Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T05:48:18.290Z] "POST /llm/e2e-rt-sw-2b6908/anything/e2e-rt-sw-2b6908-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 97 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "22cfeeba-6017-45c7-bb61-6ff805248490" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-2b6908.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:41896 - llm.external-model-e2e-rt-sw-2b6908-8999a080558e.2 2026-11-01T05:48:29.410700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:29.410738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:29.410753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:29.410759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T05:48:29.410970Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T05:48:29.347Z] "POST /llm/e2e-rt-sw-2b6908/anything/e2e-rt-sw-2b6908-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 63 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "9710a429-5469-465d-b8ba-1bae5a6f3935" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-2b6908.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:55014 - llm.external-model-e2e-rt-sw-2b6908-8999a080558e.2 2026-11-01T05:48:40.560526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:40.560561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:40.560573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T05:48:40.560578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:48:40.560744Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T05:48:40.402Z] "POST /anything/e2e-rt-sw-2b6908-client HTTP/1.1" 200 - via_upstream - "-" 124 1762 158 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c0f7352d-2c48-40ee-afea-10dcb82279ff" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:59248 10.132.0.33:443 10.132.0.14:36840 - llm.external-model-e2e-rt-sw-2b6908-8999a080558e.0 2026-11-01T05:48:49.944971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:49:04.152045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:49:04.152075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:49:04.152084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T05:49:04.152088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:49:04.152240Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-11-01T05:49:04.472565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:49:04.472601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:49:04.472611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T05:49:04.472615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T05:49:04.472757Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T05:49:04.016Z] "POST /anything/e2e-rt-sw-2b6908-client HTTP/1.1" 200 - via_upstream - "-" 124 1764 136 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "1de50312-8027-4276-bcd1-d1c47b12bc64" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:59248 10.132.0.33:443 10.132.0.14:57798 - llm.external-model-e2e-rt-sw-2b6908-8999a080558e.0 [2026-11-01T05:49:04.362Z] "POST /anything/e2e-rt-sw-2b6908-client HTTP/1.1" 200 - via_upstream - "-" 124 1763 110 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "98c22eaf-69b6-458e-8f25-24f51ec11a4a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:59248 10.132.0.33:443 10.132.0.14:57800 - llm.external-model-e2e-rt-sw-2b6908-8999a080558e.0 2026-11-01T05:49:04.792618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:49:04.792649Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:49:04.792659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T05:49:04.792664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T05:49:04.792836Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T05:49:04.664Z] "POST /anything/e2e-rt-sw-2b6908-client HTTP/1.1" 200 - via_upstream - "-" 124 1764 128 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d1d65ac3-c3cf-44ff-88df-c5dc7eb8391b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:44146 10.132.0.33:443 10.132.0.14:57816 - llm.external-model-e2e-rt-sw-2b6908-8999a080558e.0 2026-11-01T05:49:16.104477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:49:41.358127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T05:50:16.842Z] "POST /llm/e2e-rt-eq-da1565/anything/e2e-rt-eq-da1565-client HTTP/1.1" 503 - - "-" 124 0 67 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "08d1c1a0-56af-4689-87bb-ab2ef008f3eb" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-da1565.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:41912 - llm.external-model-e2e-rt-eq-da1565-838752876364.4 [2026-11-01T05:50:22.261Z] "POST /llm/e2e-rt-eq-da1565/anything/e2e-rt-eq-da1565-client HTTP/1.1" 503 - - "-" 124 0 60 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "ec2a071b-d455-4d4e-8127-ae7cbf03a509" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-da1565.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:46620 - llm.external-model-e2e-rt-eq-da1565-838752876364.4 [2026-11-01T05:50:43.419Z] "POST /llm/e2e-rt-eq-da1565/anything/e2e-rt-eq-da1565-client HTTP/1.1" 503 - - "-" 124 0 88 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "cc896edd-ea95-4374-89e3-7e3666b12d2e" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-da1565.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:54918 - llm.external-model-e2e-rt-eq-da1565-838752876364.4 [2026-11-01T05:50:48.704Z] "POST /llm/e2e-rt-eq-da1565/anything/e2e-rt-eq-da1565-client HTTP/1.1" 503 - - "-" 124 0 92 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e5d51b94-0159-4dae-aea4-0620e04f3ced" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-da1565.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:48154 - llm.external-model-e2e-rt-eq-da1565-838752876364.4 [2026-11-01T05:51:04.762Z] "POST /llm/e2e-rt-eq-da1565/anything/e2e-rt-eq-da1565-client HTTP/1.1" 503 - - "-" 124 0 158 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "44a78b0c-8463-475a-a4e8-ea5b1076f632" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-da1565.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:45630 - llm.external-model-e2e-rt-eq-da1565-838752876364.4 [2026-11-01T05:51:10.219Z] "POST /llm/e2e-rt-eq-da1565/anything/e2e-rt-eq-da1565-client HTTP/1.1" 503 - - "-" 124 0 65 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "1843561b-e2da-4a93-b9aa-bfe05705ee90" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-da1565.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:42166 - llm.external-model-e2e-rt-eq-da1565-838752876364.4 [2026-11-01T05:51:15.486Z] "POST /llm/e2e-rt-eq-da1565/anything/e2e-rt-eq-da1565-client HTTP/1.1" 503 - - "-" 124 0 141 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "f40e5f69-8f6d-4f81-acaa-a088e10675f8" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-da1565.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:42186 - llm.external-model-e2e-rt-eq-da1565-838752876364.4 2026-11-01T05:53:11.878017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:53:19.285902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:53:38.952738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:54:13.889465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:55:50.597570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:56:42.417611Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-01T06:01:44.896808Z info ads ADS: "" 3 terminated 2026-11-01T06:10:21.436308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:10:21.436359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:10:21.436386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:10:21.436394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T06:10:21.256Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 180 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c41f2f37-b408-4ba4-b4c6-b9ca28821fd5" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:33458 10.132.0.33:443 10.132.0.14:50674 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:10:29.564543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:10:54.625473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:11:34.005188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:11:41.852Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 147 412 89 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "6ed8ccce-9879-4688-b07b-7f9eb4318e5c" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:40556 10.132.0.33:443 10.132.0.14:45730 - v1-chat-completions-path [2026-11-01T06:11:42.157Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 2817 3089 64 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c216f2bc-83ae-481c-ba83-fe510144dd49" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:40558 10.132.0.33:443 10.132.0.14:45738 - v1-chat-completions-path [2026-11-01T06:11:44.149Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 62 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d87edea2-0f9c-428f-8eea-a15bfe5a1f00" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:40558 10.132.0.33:443 10.132.0.14:45768 - v1-chat-completions-path [2026-11-01T06:11:44.412Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 58 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "498bbec5-d1a4-4ac7-82f4-c7c4eb360763" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:40558 10.132.0.33:443 10.132.0.14:45778 - v1-chat-completions-path 2026-11-01T06:11:56.913820Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:11:56.913843Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:11:56.913846Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:11:56.913850Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T06:11:56.694Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 219 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "7a84bda7-ba15-42f2-9ac4-9f2295ad3f9b" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:56420 - v1-catch-all-path 2026-11-01T06:11:58.207256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:02.758835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:12.531458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:16.821078Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T06:12:16.727Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 93 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "99c719cb-8123-4ae8-8912-3dadeaf224e8" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:39380 10.132.0.33:443 10.132.0.14:45070 - v1-catch-all-path 2026-11-01T06:12:26.097217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:35.292813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:51.864500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:03.466688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:06.589923Z info ads ADS: new connection for node:5 2026-11-01T06:13:06.590050Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:06.590076Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:10.261364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:49.415686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:13.274246Z info ads ADS: "" 5 terminated 2026-11-01T06:14:13.326600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:18.140603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:32.854172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:44.706531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:11.430273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:36.555175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:41.213594Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-01T06:15:51.806763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:59.640670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:15:59.640710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:15:59.640728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:15:59.640733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:16:00.268869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:15:59.513Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 126 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "a5e294c8-f0bc-4bf9-b54e-37b91f798925" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:45060 10.132.0.33:443 10.132.0.14:60612 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:16:15.693826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:20.488622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:23.516654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:16:23.516695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:16:23.516712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:16:23.516717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:16:23.458Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 58 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "26bd46c9-707e-4cc8-ac34-b915379d1898" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:41142 10.132.0.33:443 10.132.0.14:33006 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:16:38.690987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:17:09.928Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 73 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "67ef6502-a529-4aba-998d-2ba5cb080edc" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:54622 10.132.0.33:443 10.132.0.14:60120 - v1-completions-path 2026-11-01T06:17:27.609666Z info ads ADS: new connection for node:6 2026-11-01T06:17:27.613618Z info cache read certificate from file resource=file-root:system 2026-11-01T06:17:31.237768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:32.610640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:18:05.707400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:05.707437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:05.707449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:18:05.707456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:05.707630Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T06:18:05.564Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 143 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "3be76d7c-61a5-4b8d-a22d-8b5541aaacb7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:49922 10.132.0.33:443 10.132.0.14:60696 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:18:52.141410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:52.141443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:52.141453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:18:52.141458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:52.141603Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T06:18:52.022Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 118 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "367293b4-c456-457c-be9b-647d9163dcd8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:49922 10.132.0.33:443 10.132.0.14:46246 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:18:59.140711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:59.140746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:59.140757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:18:59.140761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:59.140936Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T06:18:58.964Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 176 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "96391f26-6576-49ad-a3d4-207fd5570c81" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:56110 10.132.0.33:443 10.132.0.14:40712 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:19:01.454693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:19:01.454728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:19:01.454740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:19:01.454745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:19:01.454941Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T06:19:01.342Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 112 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "a29acf8a-55a8-486d-bc9e-e1b0c02c1e98" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:49922 10.132.0.33:443 10.132.0.14:40742 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:19:23.738898Z info ads ADS: "" 6 terminated 2026-11-01T06:19:23.779236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:26.341177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:36.570804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:39.163759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:19:39.163819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:19:39.163835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:19:39.163840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T06:19:39.026Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 137 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "8cd91ffd-2b98-4877-a427-62fe535ef653" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:42290 10.132.0.33:443 10.132.0.14:57436 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:19:54.878272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:11.770226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:20:20.518Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "32a32d4a-ed91-401b-a0fd-9d716eef66ed" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:44330 - v1-completions-path [2026-11-01T06:20:21.576Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 73 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d92efdae-cca2-4cb8-a03f-ee820ecee86d" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:57124 10.132.0.33:443 10.132.0.14:44340 - v1-completions-path 2026-11-01T06:20:42.478085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:53.037499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:59.449236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:21:14.282Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "ecddbadc-cc22-4cfb-9717-f47603a2097d" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:57124 10.132.0.33:443 10.132.0.14:34796 - v1-completions-path 2026-11-01T06:21:28.088312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:32.651066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:45.947692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:55.903966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:19.596854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:30.190849Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:48.179490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:54.308522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:12.483346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:17.893945Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:29.219704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:55.975123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:06.678300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:54.870556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:25:02.480304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:16.539745Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:45.021673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:50.990220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:28:50.990253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:28:50.990265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:28:50.990270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-01T06:28:50.877Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 112 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "271cfdeb-8c0b-46b4-8d19-b4e205b9ae01" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:51946 10.132.0.33:443 10.132.0.14:52914 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:29:04.547190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:09.510877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:12.111063Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T06:29:12.111094Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T06:29:12.111099Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T06:29:12.111104Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-01T06:29:10.059Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 92 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "759230e5-b581-4f1e-a1c5-90fb5797bb22" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:54622 10.132.0.33:443 10.132.0.14:55138 - v1-completions-path [2026-11-01T06:29:12.045Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 65 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "809816f6-98b0-4eb1-94fe-c5d9cfc86be7" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:55150 - v1-completions-path 2026-11-01T06:29:21.360413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:38.111861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:43.035570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:02.735046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:13.388265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:19.913387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:30:34.372Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "011ee0c3-f870-44f8-9344-f8dc60ee747b" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.132.0.14:34970 - v1-completions-path 2026-11-01T06:30:48.865185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:55.328949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:01.220920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:31:11.010Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "24c413df-f9b6-49c0-9221-af47c3e43c04" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:47150 10.132.0.33:443 10.132.0.14:43558 - v1-completions-path [2026-11-01T06:31:11.735Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "36616c7d-107b-45d6-ae6e-cf0435203326" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:57124 10.132.0.33:443 10.132.0.14:43570 - v1-completions-path [2026-11-01T06:31:14.513Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "5b205b8e-4b59-4b3a-b913-1d6df230732b" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:57124 10.132.0.33:443 10.132.0.14:43580 - v1-completions-path 2026-11-01T06:31:33.402416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:44.082362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:50.695216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:56.541206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:08.562633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:32.218808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:42.896119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:47.642018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:05.797382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:11.915730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:35.595254Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:57.630894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:17.529460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:28.427493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:39.354891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:50.285677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:01.017287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:11.818073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:22.571335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:33.205653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:35:44.208Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 68 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "df61edcd-3a77-428f-8bc5-c168ee66e247" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:54622 10.132.0.33:443 10.132.0.14:38748 - v1-completions-path