2026-11-03T22:11:43.905712Z info FLAG: --concurrency="0" 2026-11-03T22:11:43.905730Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T22:11:43.905734Z info FLAG: --help="false" 2026-11-03T22:11:43.905736Z info FLAG: --log_as_json="false" 2026-11-03T22:11:43.905738Z info FLAG: --log_caller="" 2026-11-03T22:11:43.905740Z info FLAG: --log_output_level="default:info" 2026-11-03T22:11:43.905742Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T22:11:43.905747Z info FLAG: --log_target="[stdout]" 2026-11-03T22:11:43.905749Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T22:11:43.905751Z info FLAG: --outlierLogPath="" 2026-11-03T22:11:43.905753Z info FLAG: --profiling="true" 2026-11-03T22:11:43.905755Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T22:11:43.905757Z info FLAG: --proxyLogLevel="warning" 2026-11-03T22:11:43.905759Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T22:11:43.905761Z info FLAG: --stsPort="0" 2026-11-03T22:11:43.905763Z info FLAG: --templateFile="" 2026-11-03T22:11:43.905767Z info FLAG: --tokenManagerPlugin="" 2026-11-03T22:11:43.905771Z info FLAG: --vklog="0" 2026-11-03T22:11:43.905775Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T22:11:43.905941Z info Proxy role ips=[10.133.1.96] type=router id=maas-default-gateway-openshift-default-8b9c49cd7-5swkz.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T22:11:43.905994Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T22:11:43.907269Z info cpu limit detected as 2, setting concurrency 2026-11-03T22:11:43.907558Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T22:11:43.907570Z info JWT policy is third-party-jwt 2026-11-03T22:11:43.907573Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T22:11:43.909735Z info Starting default Istio SDS Server 2026-11-03T22:11:43.909761Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T22:11:43.909788Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T22:11:43.910273Z info Opening status port 15020 2026-11-03T22:11:43.910978Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T22:11:43.911870Z info sds Starting SDS grpc server 2026-11-03T22:11:43.911885Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T22:11:43.912609Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T22:11:43.913393Z info Starting proxy agent 2026-11-03T22:11:43.913425Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T22:11:43.974595Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T22:11:44.048948Z info cache generated new workload certificate resourceName=default latency=136.910953ms ttl=23h59m59.951055175s 2026-11-03T22:11:44.048991Z info cache Root cert has changed, start rotating root cert 2026-11-03T22:11:44.049027Z info cache returned workload trust anchor from cache ttl=23h59m59.950972926s 2026-11-03T22:11:44.123070Z info ads ADS: new connection for node:1 2026-11-03T22:11:44.123133Z info cache returned workload certificate from cache ttl=23h59m59.876868478s 2026-11-03T22:11:44.124029Z info ads ADS: new connection for node:2 2026-11-03T22:11:44.124099Z info cache returned workload trust anchor from cache ttl=23h59m59.875902195s 2026-11-03T22:11:44.209296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:11:52.099939Z info Readiness succeeded in 8.196603427s 2026-11-03T22:11:52.100249Z info Envoy proxy is ready 2026-11-03T22:12:15.985283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:12:18.553131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:12:18.553168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:12:18.553181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:12:18.553186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T22:12:18.427Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 304 126 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "ea4eef3f-39f6-45ee-a8ea-98ee62173a1b" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.96:60012 10.133.1.96:443 10.132.0.21:37944 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T22:12:19.072Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 2817 3089 84 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "9fef8827-c8be-4cb4-8071-f81ff84f5e08" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:39310 10.133.1.96:443 10.132.0.21:37960 - v1-chat-completions-path [2026-11-03T22:12:19.367Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 291 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "38ff6171-5092-4c37-8995-7f5bdbe5dbf2" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:39310 10.133.1.96:443 10.132.0.21:37968 - v1-chat-completions-path 2026-11-03T22:12:33.704046Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T22:12:33.704074Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T22:12:33.704077Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T22:12:33.704080Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T22:12:33.520Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 183 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "2d7ec7ca-8ddf-4a79-b6fd-d2e5e3d90f4b" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.96:443 10.132.0.21:38586 - v1-catch-all-path 2026-11-03T22:12:35.318389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:12:40.312059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:12:43.003182Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 2026-11-03T22:12:43.699354Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T22:12:42.906Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 96 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "96a44b23-978a-4ccf-8d81-2e7004158af0" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:50236 10.133.1.96:443 10.132.0.21:51458 - v1-catch-all-path [2026-11-03T22:12:43.641Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 57 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3c27eb47-1e3c-453d-a0cd-6903392332f7" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:50236 10.133.1.96:443 10.132.0.21:51478 - v1-catch-all-model-routing 2026-11-03T22:12:48.814862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:12:52.295670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T22:12:52.299360Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T22:12:52.240Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "40159aca-10d2-4cd6-beee-d5d738f5e38e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:50236 10.133.1.96:443 10.132.0.21:55566 - v1-catch-all-path 2026-11-03T22:12:53.372921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T22:12:53.373483Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T22:12:53.312Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 60 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "375545b0-2ebd-41d0-95ae-e5f7ed029431" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:53722 10.133.1.96:443 10.132.0.21:55578 - v1-catch-all-path 2026-11-03T22:13:03.168159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:12.273449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:15.017923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:13:15.017957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:13:15.017971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T22:13:15.017976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T22:13:14.897Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 120 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "fec9f507-0df6-4eb8-a784-08c6e954e722" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.96:60012 10.133.1.96:443 10.132.0.21:50254 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:13:29.290164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:40.987168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:13:44.594903Z info ads ADS: new connection for node:3 2026-11-03T22:13:44.595038Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T22:13:44.595071Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T22:13:48.018706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:14:26.904736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:14:51.967932Z info ads ADS: "" 3 terminated 2026-11-03T22:14:52.028580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:14:56.410646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:15:13.171805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:17:51.354786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:17:51.354821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:17:51.354837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:17:51.354842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T22:17:51.236Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 117 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f7a8a656-2f3a-4303-993b-8f5eb930dcd0" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.96:39414 10.133.1.96:443 10.132.0.21:48214 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:17:53.230137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:17:53.230171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:17:53.230183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:17:53.230188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T22:17:53.497946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:17:53.497978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:17:53.497990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:17:53.497995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T22:17:53.167Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 62 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "fc21686b-136d-4cd4-82e8-70b940d1c445" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.96:39418 10.133.1.96:443 10.132.0.21:48232 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T22:17:53.450Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 47 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "505317da-4532-4787-915e-9f647ef67f95" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.96:39414 10.133.1.96:443 10.132.0.21:48246 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:18:00.375477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:18:30.126512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:00.546517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:16.132089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:31.226537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:43.729158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:19:48.837792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:19:52.386Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "6c311323-fdef-44d7-87b7-14f60847f3f2" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46546 10.133.1.96:443 10.132.0.21:47448 - v1-completions-path [2026-11-03T22:19:52.944Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a54948c0-5e77-4ae3-9354-ace5038062ed" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:47464 - v1-completions-path 2026-11-03T22:20:09.678763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:20:12.661Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 80 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "39e9e86a-7ce0-46ac-9377-aa40b213a5bf" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:42570 10.133.1.96:443 10.132.0.21:47794 - v1-completions-path 2026-11-03T22:20:57.379672Z info ads ADS: new connection for node:4 2026-11-03T22:20:57.383326Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T22:20:57.383373Z info cache read certificate from file resource=file-root:system 2026-11-03T22:21:01.219285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:21:02.386528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:21:22.147255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:22.147284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:22.147293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:21:22.147297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:21:22.147441Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T22:21:21.948Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1530 199 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f74b938d-91e8-4923-b6cb-fc91d6b2f7ca" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.96:37234 10.133.1.96:443 10.132.0.21:54834 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:21:55.460279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:21:55.460313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:21:55.460325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:21:55.460330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T22:21:55.460482Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T22:21:55.262Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1538 198 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "fe41aea7-3432-4cb5-a45c-382f13eb0673" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.96:48386 10.133.1.96:443 10.132.0.21:48948 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:26.024758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:22:26.024787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:22:26.024797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T22:22:26.024802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:22:26.024948Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T22:22:25.900Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1539 124 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "1d33a3d4-4979-43c7-89f1-e03dc6adc758" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.96:48386 10.133.1.96:443 10.132.0.21:41844 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:35.372792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:35.372822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:35.372833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:22:35.372839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:35.372997Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T22:22:35.248Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1538 124 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c8358077-6e78-434d-9739-243dc78596bd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.96:37234 10.133.1.96:443 10.132.0.21:35624 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:37.694615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:37.694660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:37.694670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:22:37.694674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:22:37.694821Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T22:22:37.574Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1539 120 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a7e0cbe9-d99d-4efc-bf41-82f3e1327cc7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.96:37234 10.133.1.96:443 10.132.0.21:42346 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T22:22:57.779243Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T22:22:59.444345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:23:00.457247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:23:11.173383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:23:14.516Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a9c0aa49-1497-47ee-bdbe-98bfe01248ea" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:33970 - v1-completions-path 2026-11-03T22:23:29.680480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:23:34.316044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:23:37.272Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 57 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "aec82dd8-520a-4475-91b2-dc3898e97d3e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:42980 - v1-completions-path [2026-11-03T22:23:37.787Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 57 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "7813a3a0-4bbc-4801-9a8f-f3d1f375ed61" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:42996 - v1-completions-path [2026-11-03T22:23:38.838Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 56 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "20d5cd52-7027-460f-901a-5bb53c36f6bb" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:43004 - v1-completions-path 2026-11-03T22:23:58.864933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:24:11.986428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:24:21.437Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "2b4c85c0-21d0-458a-85c5-49f910b1c95b" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46546 10.133.1.96:443 10.132.0.21:34610 - v1-completions-path [2026-11-03T22:24:21.692Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "0f1a33f5-ba9e-4631-80ad-1e1565ff5511" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:34622 - v1-completions-path [2026-11-03T22:24:22.195Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 53 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "82b07ab7-a263-44b0-a4f7-60c9d9b8844b" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46546 10.133.1.96:443 10.132.0.21:34630 - v1-completions-path [2026-11-03T22:24:23.730Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 54 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f31b0a1b-3d5d-4a7d-a5cd-744999d3c11f" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:34640 - v1-completions-path 2026-11-03T22:24:42.633873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:24:53.237587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:24:59.720525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:25:11.166Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c8ea17b6-4b64-4c21-a091-d12d0be5e9a8" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46546 10.133.1.96:443 10.132.0.21:34526 - v1-completions-path [2026-11-03T22:25:11.962Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "9c98e312-6c6b-43d6-92b8-37baf2f03058" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46546 10.133.1.96:443 10.132.0.21:34530 - v1-completions-path 2026-11-03T22:25:28.086036Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:25:32.925141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:25:36.207Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 293 130 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "d534cd92-3109-4cbb-9214-c2cb73f09f53" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:40974 10.133.1.96:443 10.132.0.21:51532 - v1-completions-path 2026-11-03T22:25:46.515973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:25:55.719659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:06.339259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:12.844155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:27.746211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:39.829066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:26:44.815217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:27:03.330698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:27:05.419096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:27:05.419131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:27:05.419145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:27:05.419150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T22:27:05.305Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 114 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "ac77fbce-55cf-4add-90c5-c4326077715e" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.96:56486 10.133.1.96:443 10.132.0.21:40904 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T22:27:05.608Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a2cab5f7-4b1b-4828-8f09-ab103e4b8f61" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.96:443 10.132.0.21:40916 - v1-completions-path [2026-11-03T22:27:07.875Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "d4d9fc6a-0fff-40d8-a7af-1c5b6a084cef" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.96:443 10.132.0.21:52810 - v1-completions-path 2026-11-03T22:27:08.991389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:27:10.394Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "d4c9fec2-ac71-4ba2-8e75-84603aa7f919" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.96:443 10.132.0.21:52824 - v1-completions-path 2026-11-03T22:27:20.374405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:27:46.706096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:27:57.437133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:28:17.118892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:28:24.425517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:30:51.499820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:31:58.245667Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T22:31:58.245688Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T22:31:58.245691Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T22:31:58.245695Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T22:31:58.201Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 44 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b6348a0c-a8e8-48a3-81af-e0e2d6a9a0ed" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.96:443 10.132.0.21:47644 - v1-completions-path 2026-11-03T22:32:18.985394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:32:32.784917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:32:32.784954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:32:32.784969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:32:32.784975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T22:32:32.671Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 113 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f8a1240c-0be4-99a9-9c10-f2f3b50e4fb1" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.96:47688 10.133.1.96:443 10.132.0.21:59612 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:32:46.546661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:32:51.259586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:04.042358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:20.989139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:25.708802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:46.151013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:33:56.646500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:34:02.702716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:34:12.687413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:34:12.687447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T22:34:12.687461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T22:34:12.687465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T22:34:12.571Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 116 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "57122eed-ddfb-4e07-873f-01bf612ce4b6" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.132.0.166:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.96:44280 10.133.1.96:443 10.132.0.21:49402 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T22:34:13.223Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a1b6ce36-7111-4e64-8d0c-44d0a6f3dd40" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46546 10.133.1.96:443 10.132.0.21:49416 - v1-completions-path [2026-11-03T22:34:14.480Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "ed3baedc-1cdb-44b6-934d-d334fef90349" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:49422 - v1-completions-path 2026-11-03T22:34:29.868675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:34:36.019119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:34:42.053558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:34:53.457Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "6ba14226-4255-4315-bed5-a336c55b1949" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:60930 - v1-completions-path 2026-11-03T22:35:12.592020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:35:23.294762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:35:29.597597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:35:35.443717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:35:47.890880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:35:54.351Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "efe917f3-bbed-4bc4-9146-4499bb4cd071" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46556 10.133.1.96:443 10.132.0.21:48674 - v1-completions-path [2026-11-03T22:35:55.092Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "06d08cb6-6cb9-4e23-8d82-2c802a601611" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.96:46546 10.133.1.96:443 10.132.0.21:48682 - v1-completions-path 2026-11-03T22:36:11.274791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:21.973377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:26.793938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:45.031731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:36:51.189295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:37:12.817761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:37:34.763495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:37:56.803581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:16.598780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:27.488667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:38.409348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:49.063725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:38:59.871628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:39:10.563265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:39:17.231Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 40 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "97a68b1e-1be4-4fc5-9f43-99ff9ebaff91" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.96:443 10.132.0.21:50400 - v1-completions-path 2026-11-03T22:39:17.502885Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T22:39:17.502909Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T22:39:17.502912Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T22:39:17.502916Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T22:39:17.476Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 26 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c4b13982-058a-4e98-a73b-afa945ea9572" "maas.apps.4ddbac784716b2f7da33.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.96:443 10.132.0.21:50402 - v1-completions-path