2026-11-02T13:53:16.019915Z info FLAG: --concurrency="0" 2026-11-02T13:53:16.020001Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T13:53:16.020006Z info FLAG: --help="false" 2026-11-02T13:53:16.020008Z info FLAG: --log_as_json="false" 2026-11-02T13:53:16.020010Z info FLAG: --log_caller="" 2026-11-02T13:53:16.020012Z info FLAG: --log_output_level="default:info" 2026-11-02T13:53:16.020015Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T13:53:16.020019Z info FLAG: --log_target="[stdout]" 2026-11-02T13:53:16.020022Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T13:53:16.020023Z info FLAG: --outlierLogPath="" 2026-11-02T13:53:16.020025Z info FLAG: --profiling="true" 2026-11-02T13:53:16.020027Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T13:53:16.020029Z info FLAG: --proxyLogLevel="warning" 2026-11-02T13:53:16.020032Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T13:53:16.020034Z info FLAG: --stsPort="0" 2026-11-02T13:53:16.020036Z info FLAG: --templateFile="" 2026-11-02T13:53:16.020038Z info FLAG: --tokenManagerPlugin="" 2026-11-02T13:53:16.020040Z info FLAG: --vklog="0" 2026-11-02T13:53:16.020043Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T13:53:16.020183Z info Proxy role ips=[10.134.0.44] type=router id=maas-default-gateway-openshift-default-6886b96f9-49rxk.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T13:53:16.020233Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T13:53:16.021321Z info cpu limit detected as 2, setting concurrency 2026-11-02T13:53:16.021539Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T13:53:16.021550Z info JWT policy is third-party-jwt 2026-11-02T13:53:16.021553Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T13:53:16.022993Z info Starting default Istio SDS Server 2026-11-02T13:53:16.023017Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T13:53:16.023034Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T13:53:16.023382Z info Opening status port 15020 2026-11-02T13:53:16.024188Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T13:53:16.025376Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T13:53:16.026159Z info Starting proxy agent 2026-11-02T13:53:16.026189Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T13:53:16.036181Z info sds Starting SDS grpc server 2026-11-02T13:53:16.036196Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T13:53:16.088381Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T13:53:16.197278Z info ads ADS: new connection for node:1 2026-11-02T13:53:16.197973Z info ads ADS: new connection for node:2 2026-11-02T13:53:16.259893Z info cache generated new workload certificate resourceName=default latency=235.445486ms ttl=23h59m59.740110208s 2026-11-02T13:53:16.259924Z info cache Root cert has changed, start rotating root cert 2026-11-02T13:53:16.259980Z info cache returned workload trust anchor from cache ttl=23h59m59.740020328s 2026-11-02T13:53:16.259972Z info cache returned workload certificate from cache ttl=23h59m59.740035521s 2026-11-02T13:53:16.260064Z info cache returned workload trust anchor from cache ttl=23h59m59.739936112s 2026-11-02T13:53:16.260341Z info cache returned workload trust anchor from cache ttl=23h59m59.739659658s 2026-11-02T13:53:16.339588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:53:24.138830Z info Readiness succeeded in 8.121857536s 2026-11-02T13:53:24.139176Z info Envoy proxy is ready 2026-11-02T13:56:48.011884Z info ads ADS: new connection for node:3 2026-11-02T13:56:48.017919Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T13:56:48.017990Z info cache read certificate from file resource=file-root:system 2026-11-02T13:56:49.610542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:54.281838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:06.779475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:14.445400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:57:14.445436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:57:14.445446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:57:14.445451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:57:14.445607Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T13:57:14.324Z] "POST /anything/e2e-rt-eq-1f1dee-client HTTP/1.1" 200 - via_upstream - "-" 124 1758 120 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "5fab9de3-4399-4b6f-8ec3-35e7379eb873" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:50078 10.134.0.44:443 10.132.0.19:50614 - llm.external-model-e2e-rt-eq-1f1dee-67535b35bdaa.2 2026-11-02T13:57:35.744479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:45.743192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:03.889972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:40.632027Z info ads ADS: "" 3 terminated with stream closed 2026-11-02T13:58:40.763681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:41.029660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:51.278512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:24.831368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:50.175294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:13.826247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:02:14.779237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:05.939996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:47.325025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:03:47.325060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:03:47.325076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:03:47.325081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:03:47.233Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 91 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "6d693f9f-9d95-433f-8ec4-f32eef7fb332" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:41612 10.134.0.44:443 10.132.0.19:34836 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:03:47.474Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "2114f6f9-8fa6-4fd0-8409-64cfb4164ea0" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.44:443 10.132.0.19:39834 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:03:49.417Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 66 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "84c0be98-1602-4803-8c01-1d0810c366e5" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.44:443 10.132.0.19:39846 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:03:51.561271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:03:51.561313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:03:51.561329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:03:51.561334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:03:51.977658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:03:51.977699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:03:51.977717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:03:51.977724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:03:51.402Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 158 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b61f9785-cd25-4cfa-8036-4d660ece09cf" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:41614 10.134.0.44:443 10.132.0.19:39878 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:03:51.884Z] "DELETE /v1/api-keys/340b15fc-a786-40ff-a6b4-94eea833545d HTTP/1.1" 200 - via_upstream - "-" 0 321 93 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d47da707-a76e-4fc4-9f53-1d44dda72ab9" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:41612 10.134.0.44:443 10.132.0.19:39880 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:03:57.185Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 47 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "ac4298a8-5891-42fe-ba2f-0c35d03727a3" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.132.0.19:39896 - v1-completions-path 2026-11-02T14:04:02.011044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:04:02.011094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:04:02.011117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:04:02.011123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:04:01.919Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 91 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "7ef3193d-2390-479b-825a-c0762f192762" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:41612 10.134.0.44:443 10.132.0.19:53506 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:11:01.980191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:11:01.980232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:11:01.980248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:11:01.980254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:11:02.085527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T14:11:01.879Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 100 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "f8897c30-d3c6-4dde-a6cf-263691a4382b" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:38672 10.134.0.44:443 10.132.0.19:57862 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:11:02.003Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 321 103 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "00f7462a-73f9-41e4-a132-a16d45b9abda" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:56676 10.134.0.44:443 10.132.0.19:57868 - v1-chat-completions-path [2026-11-02T14:11:02.143Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 318 83 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "1234de29-3824-4521-9067-290aaa7417ee" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:56678 10.134.0.44:443 10.132.0.19:57884 - v1-chat-completions-path [2026-11-02T14:11:26.611Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 338 197 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "5452dce5-4388-40bf-ac1f-25afe6a62d0a" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:56676 10.134.0.44:443 10.132.0.19:58174 - v1-chat-completions-path 2026-11-02T14:14:03.385295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:14:03.385449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:14:03.385514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:14:03.385548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:14:03.239Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 146 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "5f8ae099-bdba-478c-8666-7e1627db366e" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:52008 10.134.0.44:443 10.132.0.19:38318 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:20:52.537542Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T14:23:10.016621Z info ads ADS: new connection for node:4 2026-11-02T14:23:10.024529Z info cache read certificate from file resource=file-root:system 2026-11-02T14:29:56.674250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:30:29.471110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:30:34.768445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T14:30:34.768522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:30:34.768537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:30:34.768546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:30:34.768550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:30:34.768711Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:30:34.625Z] "POST /anything/e2e-dft-f7e426-8c8c28 HTTP/1.1" 200 - via_upstream - "-" 109 1761 143 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "879495c8-f0a6-42dd-8f3b-3ba3327fdadc" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:36994 10.134.0.44:443 10.132.0.19:54378 - llm.external-model-e2e-dft-f7e426-2f3859a42bfa.0 2026-11-02T14:31:12.374851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:32:27.608131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:32:36.095804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:32:36.095854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:32:36.095873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:32:36.095880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:32:36.096172Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:32:35.465Z] "POST /anything/e2e-dft-915022-0c9df5 HTTP/1.1" 200 - via_upstream - "-" 109 1770 631 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "a4b3ddd9-7a16-4ca4-84c0-f91b190f17a2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:35702 10.134.0.44:443 10.132.0.19:59452 - llm.external-model-e2e-dft-915022-82471eaef56b.0 2026-11-02T14:33:08.252476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:33:25.095491Z info ads ADS: new connection for node:5 2026-11-02T14:33:25.095739Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T14:33:25.095800Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T14:33:34.111241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:34:04.753520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:34:10.963438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:34:10.963478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:34:10.963495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:34:10.963500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:34:11.211359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:34:11.211405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:34:11.211423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:34:11.211430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:34:11.211720Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:34:10.859Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 103 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "305eedb3-84f7-4090-8443-48de9b36d24f" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:50242 10.134.0.44:443 10.132.0.19:37874 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:34:10.998Z] "POST /anything/e2e-dft-856d83-02ef2c HTTP/1.1" 200 - via_upstream - "-" 109 1771 213 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "a8041bdd-c0ed-4f22-9329-0d34cafb3c6c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:33974 10.134.0.44:443 10.132.0.19:37890 - llm.external-model-e2e-dft-856d83-8eee74030457.0 2026-11-02T14:34:23.507330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:34:59.202070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:38:17.922870Z info ads ADS: "" 5 terminated 2026-11-02T14:38:20.419127Z info ads ADS: "" 4 terminated 2026-11-02T14:42:16.348445Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-02T14:47:29.197071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:48:07.676996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:49:37.213130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:50:09.665618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:51:35.503040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:51:37.374868Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T15:00:01.878985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:00:24.045102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:00:56.530084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:12.576948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:15.895035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:22.326301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:25.952868Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-02T15:01:25.869Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 83 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "9aa9282d-2a6a-4679-aa5f-d46779193933" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.27:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:54964 10.134.0.44:443 10.132.0.19:49002 - v1-catch-all-path 2026-11-02T15:01:29.752504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:39.538926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:54.513242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:05.485592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:07.218542Z info ads ADS: new connection for node:6 2026-11-02T15:02:07.218845Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T15:02:07.218908Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T15:02:08.083708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:49.855343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:03:07.641Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 37 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "65ffb41d-420f-421a-81c5-96991e98ccdd" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-4711881d-inference-pool-ip-b5571c7c.llm.svc.cluster.local - 10.134.0.44:443 10.132.0.19:46742 - v1-model-routing 2026-11-02T15:03:08.979897Z info ads ADS: "" 6 terminated 2026-11-02T15:03:09.031956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:03:12.439925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:03:20.881348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:05:47.752124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:05:47.752164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:05:47.752179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:05:47.752186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:05:47.686Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 65 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d5777125-abd3-42ee-b4da-9c1df85e4ccf" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:51578 10.134.0.44:443 10.132.0.19:59154 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:05:52.909237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:09.165087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:25.014052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:36.868950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:41.250586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:52.513081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:07:05.930397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:07:21.323688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:08:02.394Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 68 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "3b01abc9-7202-4ad3-bc33-012722f47782" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:56678 10.134.0.44:443 10.132.0.19:57632 - v1-completions-path 2026-11-02T15:08:17.456902Z info ads ADS: new connection for node:7 2026-11-02T15:08:17.462682Z info cache read certificate from file resource=file-root:system 2026-11-02T15:08:18.499951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:08:20.078341Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:09:12.240899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:12.240962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:12.240974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:12.240979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:09:12.241148Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:09:12.119Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1711 121 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "fe23ad3b-8a8f-457e-abf0-bbbcadcd5af6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:54142 10.134.0.44:443 10.132.0.19:60544 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:10:07.500185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:07.608830Z info ads ADS: "" 7 terminated with stream closed 2026-11-02T15:10:09.016721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:14.328061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:30.354760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:34.984169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:10:38.005Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 79 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "972edcaf-90d0-45c4-a637-cf365e12c6e1" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:40652 10.134.0.44:443 10.132.0.19:38682 - v1-completions-path 2026-11-02T15:10:50.268687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:11:05.914369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:11:10.894928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:11:10.894991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:11:10.895007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T15:11:10.895011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T15:11:10.811Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 84 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "3d44256e-eb7a-4965-b1c6-b11c33e99237" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:33626 10.134.0.44:443 10.132.0.19:56764 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:11:13.107Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "7e072c6d-0672-47af-a475-01ca675e0c11" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:46648 10.134.0.44:443 10.132.0.19:56770 - v1-completions-path 2026-11-02T15:11:29.095524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:11:39.370259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:11:44.084715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:11:51.071Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 61 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4ee46dbd-b44d-4696-9ab9-1b70e483901f" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:46648 10.134.0.44:443 10.132.0.19:47744 - v1-completions-path [2026-11-02T15:11:51.555Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "19d77ef0-f119-4134-8d61-278824f04e82" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:46648 10.134.0.44:443 10.132.0.19:47756 - v1-completions-path 2026-11-02T15:12:03.900314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:06.292754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:13.941125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:23.473382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:29.074096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:37.122713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:42.682414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:00.607633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:03.883728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:19.674873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:21.264404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:13:21.264441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:13:21.264457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:13:21.264463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:13:21.182Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 82 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4495cdd8-6cd8-491d-a6da-db5ac69d4160" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:55466 10.134.0.44:443 10.132.0.19:60100 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:13:21.283Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 63 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "1c6f4bc7-359c-47ba-87cd-22b86a26d123" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.132.0.19:60110 - v1-completions-path 2026-11-02T15:13:22.697317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:30.821526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:48.291665Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:58.569043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:14:04.511143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:14:12.420034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:16:57.768979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:17:00.572279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:18:26.851462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:18:31.724Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 285 84 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4e66d62f-897a-4c2d-b012-4061f7b6153b" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:43926 10.134.0.44:443 10.132.0.19:58030 - v1-completions-path 2026-11-02T15:18:44.483269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:18:46.811819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:18:47.144500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:18:47.144554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:18:47.144578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T15:18:47.144586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T15:18:46.976Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 167 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "63b747be-4aa6-46b0-84b5-122cd195f6dc" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:52062 10.134.0.44:443 10.132.0.19:49182 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:18:54.251770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:21.037441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:24.245478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:24.379315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:24.379365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:24.379386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:24.379393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:19:24.268Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 111 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e2cc5f47-633d-42f6-8b59-11e8c05a4b2b" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:42672 10.134.0.44:443 10.132.0.19:52540 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:19:39.942136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:50.198780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:54.779878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:11.778552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:16.263536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:20.168341Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:20:26.127Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8ea78ef5-3dcb-4d99-9a92-ba25ce6d8da4" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:46648 10.134.0.44:443 10.132.0.19:55542 - v1-completions-path [2026-11-02T15:20:26.685Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 61 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "82fa25c8-d4e2-4208-9736-89aedd867dac" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.132.0.19:55558 - v1-completions-path [2026-11-02T15:20:26.944Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "9fa12e4d-1c9e-42d0-8e12-407e3a54bb18" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:40652 10.134.0.44:443 10.132.0.19:55566 - v1-completions-path [2026-11-02T15:20:27.667Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "87e6bc8f-769c-4676-86bf-d992e60ec399" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:46648 10.134.0.44:443 10.132.0.19:32906 - v1-completions-path 2026-11-02T15:20:42.550224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:52.746916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:57.397104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:01.166292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:06.257557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:24.444533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:34.689526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:36.988527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:49.434159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:52.793926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:10.834507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:13.219460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:31.571905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:41.925844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:52.223335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:02.499547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:12.851280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:23.052703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:33.404894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:40.347293Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-11-02T15:23:43.756972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:54.070856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:24:04.356306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:24:13.378Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 86 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "a68167e4-efe5-4440-a105-5aced213bcda" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:51774 10.134.0.44:443 10.132.0.19:54890 - v1-completions-path