2026-10-30T16:32:47.436557Z info FLAG: --concurrency="0" 2026-10-30T16:32:47.436600Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T16:32:47.436604Z info FLAG: --help="false" 2026-10-30T16:32:47.436607Z info FLAG: --log_as_json="false" 2026-10-30T16:32:47.436609Z info FLAG: --log_caller="" 2026-10-30T16:32:47.436611Z info FLAG: --log_output_level="default:info" 2026-10-30T16:32:47.436613Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T16:32:47.436620Z info FLAG: --log_target="[stdout]" 2026-10-30T16:32:47.436622Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T16:32:47.436624Z info FLAG: --outlierLogPath="" 2026-10-30T16:32:47.436626Z info FLAG: --profiling="true" 2026-10-30T16:32:47.436629Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T16:32:47.436630Z info FLAG: --proxyLogLevel="warning" 2026-10-30T16:32:47.436632Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T16:32:47.436634Z info FLAG: --stsPort="0" 2026-10-30T16:32:47.436636Z info FLAG: --templateFile="" 2026-10-30T16:32:47.436638Z info FLAG: --tokenManagerPlugin="" 2026-10-30T16:32:47.436640Z info FLAG: --vklog="0" 2026-10-30T16:32:47.436643Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T16:32:47.436774Z info Proxy role ips=[10.132.0.56] type=router id=maas-default-gateway-openshift-default-76f4876667-t8b5p.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T16:32:47.436814Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T16:32:47.437856Z info cpu limit detected as 2, setting concurrency 2026-10-30T16:32:47.438059Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T16:32:47.438070Z info JWT policy is third-party-jwt 2026-10-30T16:32:47.438073Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T16:32:47.439488Z info Starting default Istio SDS Server 2026-10-30T16:32:47.439519Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T16:32:47.439542Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T16:32:47.439845Z info Opening status port 15020 2026-10-30T16:32:47.440566Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T16:32:47.441239Z info sds Starting SDS grpc server 2026-10-30T16:32:47.441272Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T16:32:47.441922Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T16:32:47.442795Z info Starting proxy agent 2026-10-30T16:32:47.442825Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T16:32:47.506325Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T16:32:47.625800Z info cache generated new workload certificate resourceName=default latency=184.398064ms ttl=23h59m59.374202942s 2026-10-30T16:32:47.625835Z info cache Root cert has changed, start rotating root cert 2026-10-30T16:32:47.625864Z info cache returned workload trust anchor from cache ttl=23h59m59.374136995s 2026-10-30T16:32:47.629951Z info ads ADS: new connection for node:1 2026-10-30T16:32:47.630006Z info cache returned workload certificate from cache ttl=23h59m59.369995019s 2026-10-30T16:32:47.630881Z info ads ADS: new connection for node:2 2026-10-30T16:32:47.631026Z info cache returned workload trust anchor from cache ttl=23h59m59.368975137s 2026-10-30T16:32:47.712557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:32:55.612924Z info Readiness succeeded in 8.178627351s 2026-10-30T16:32:55.613242Z info Envoy proxy is ready 2026-10-30T16:33:36.989529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:33:36.989567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:33:36.989595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:33:36.989601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T16:33:36.884Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 104 - "34.228.250.194,10.132.0.12" "curl/7.76.1" "cd9e3290-9754-40ff-a44e-5a0bb49ef8b1" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:53502 10.132.0.56:443 10.132.0.12:58178 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:33:37.198Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 441 66 - "34.228.250.194,10.132.0.12" "curl/7.76.1" "044a053e-a5dd-424e-b075-b919921d04ed" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:47890 10.132.0.56:443 10.132.0.12:58184 - v1-model-routing [2026-10-30T16:33:38.133Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "34.228.250.194,10.132.0.12" "curl/7.76.1" "6b981347-5c64-4d1e-83f6-6549bb4f4bf7" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.12:58196 - v1-model-routing [2026-10-30T16:33:38.213Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "34.228.250.194,10.132.0.12" "curl/7.76.1" "4fbd2fd9-5fdd-41cd-b528-e8a757c7c93f" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.12:58222 - v1-model-routing 2026-10-30T16:36:10.944157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:10.944190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:10.944203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:10.944209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:36:11.200332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:11.200366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:11.200380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:36:11.200385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T16:36:10.871Z] "DELETE /v1/api-keys/0fea2cb5-bc46-488e-9d76-4e46ac86ef7b HTTP/1.1" 200 - via_upstream - "-" 0 321 72 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "6d43c3d7-2eed-47d9-a4b7-5a9cd0a5ad0d" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39320 10.132.0.56:443 10.132.0.12:56136 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:36:11.130Z] "DELETE /v1/api-keys/21d6c6fe-35f9-4b52-a587-cf718a0fd8ac HTTP/1.1" 200 - via_upstream - "-" 0 321 70 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "3dae9e1e-5064-4da5-bd3a-ee28aadc74f1" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39320 10.132.0.56:443 10.132.0.12:56156 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:36:12.152664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T16:36:12.273329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:12.273451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:12.273513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:36:12.273546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:12.381388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:12.381495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:12.381545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:36:12.381574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T16:36:12.137Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 312 135 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "3f1d0f41-5bdc-4ab9-8080-d44f1149e5b0" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39320 10.132.0.56:443 10.132.0.12:56166 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:36:12.296Z] "DELETE /v1/api-keys/89b78651-a210-46df-9377-7713fed23fac HTTP/1.1" 200 - via_upstream - "-" 0 321 85 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "3cdbd576-b89a-42b1-8739-b264eac8ba2a" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39320 10.132.0.56:443 10.132.0.12:56182 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:36:13.175338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.175383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.175403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.175410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:36:13.260517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.260549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.260562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:36:13.260567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.538898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:13.538938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:13.538959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:36:13.538965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:36:13.649420Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T16:36:13.649443Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T16:36:13.649446Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T16:36:13.649450Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T16:36:13.099Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 76 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "7a769658-8c4c-440e-8d3a-87518e8d8360" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39334 10.132.0.56:443 10.132.0.12:56186 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:36:13.195Z] "DELETE /v1/api-keys/c1a89560-0026-4ba0-815c-14101d62a365 HTTP/1.1" 200 - via_upstream - "-" 0 321 64 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "7a7f4548-fd79-45e8-8adc-a92f08a5ac8b" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39334 10.132.0.56:443 10.132.0.12:56188 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:36:13.472Z] "DELETE /v1/api-keys/67daa648-5b5d-4bde-af6d-7500142d6049 HTTP/1.1" 200 - via_upstream - "-" 0 321 66 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "7d9d222b-270c-4b97-a9ea-cae0b521d3d6" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39320 10.132.0.56:443 10.132.0.12:56198 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:36:13.619Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 30 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "a5e64f91-47ad-45d1-912d-fa3ce5771f9f" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.12:56214 - v1-completions-path 2026-10-30T16:36:13.914497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.914530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.914543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:36:13.914548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T16:36:13.843Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 312 70 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "69ea6dfc-55a3-4cfa-a5fc-f3588873c63d" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39334 10.132.0.56:443 10.132.0.12:56218 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:36:13.934Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 58 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "bee1d707-19a3-424c-b4e2-d3dc30f922dc" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:41980 10.132.0.56:443 10.132.0.12:56226 - v1-completions-path 2026-10-30T16:36:26.099767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:36:39.467542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:42:36.077349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:42:56.489256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:44:20.937134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:46:15.857272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:47:46.874602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:49:39.664503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:03:41.134098Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T17:15:34.421347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:15:34.421404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:15:34.421428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:15:34.421436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T17:15:34.329Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 92 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "2ab19c7c-17d7-47bf-944f-5d7a840596ba" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:56040 10.132.0.56:443 10.132.0.12:55776 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T17:15:34.448Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 326 76 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "1a6ca8e1-0823-46c5-8a61-ed6d247b8281" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:47890 10.132.0.56:443 10.132.0.12:55784 - v1-chat-completions-path 2026-10-30T17:18:28.617343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:18:30.978650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:18:30.978689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:18:30.978703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:18:30.978709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T17:18:30.903Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 75 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "22c1ea55-7415-4249-bed6-eb881c40ce07" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:39702 10.132.0.56:443 10.132.0.12:54466 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T17:18:52.359798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:19:46.362538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T17:19:52.471Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "e1bb439f-93cc-4b1b-a240-b04a8aeec313" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.12:38314 - v1-completions-path 2026-10-30T17:20:04.425605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:20:08.647804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:20:24.769297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:20:50.235863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T17:20:57.239Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 69 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "91f723e2-9686-4458-99f4-7e2747bf6a9e" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:36468 10.132.0.56:443 10.132.0.12:44242 - v1-completions-path [2026-10-30T17:20:58.609Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "54d53a96-77ed-4413-8a30-a03afabea52f" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:37308 10.132.0.56:443 10.132.0.12:33414 - v1-completions-path 2026-10-30T17:21:23.803917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:21:34.107068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:21:38.257815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:21:43.579978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T17:21:43.573Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "9f9823e5-71b3-4db8-b9cf-dc7a86b0b76a" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:36468 10.132.0.56:443 10.132.0.12:54538 - v1-completions-path [2026-10-30T17:21:43.656Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "4e0c121a-212a-4916-92df-e81150205082" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:36468 10.132.0.56:443 10.132.0.12:54542 - v1-completions-path [2026-10-30T17:21:44.194Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 50 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "7459d185-42f4-43e1-87ff-925bfaccc6d9" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:36468 10.132.0.56:443 10.132.0.12:54548 - v1-completions-path [2026-10-30T17:21:44.348Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "5685cfad-eca6-99b2-9dbc-6ca47388d56b" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:37308 10.132.0.56:443 10.132.0.12:54554 - v1-completions-path 2026-10-30T17:21:56.595171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:21:58.802640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:22:18.082571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T17:22:20.080Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 64 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "5c0c5d4f-05e4-40bd-b784-b8e4dd061204" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.56:47890 10.132.0.56:443 10.132.0.12:50222 - v1-completions-path 2026-10-30T17:22:23.079881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:22:38.389480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:22:40.458395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:22:59.472517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:23:10.327531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:23:21.169713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T17:23:42.924Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 32 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "f0e00213-385d-4342-9e75-87e4514cdc95" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.56:443 10.132.0.12:48072 - v1-completions-path 2026-10-30T17:25:50.174426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:25:53.214225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:27:34.259135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:27:49.079466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:27:51.310156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:28:06.210209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:29:50.227738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T17:29:50.227816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:29:50.227839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:29:50.227856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:29:50.227862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T17:29:50.152Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 326 74 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "affb8542-db65-46d0-9bc3-b3798e59a9f3" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:36744 10.132.0.56:443 10.132.0.12:48220 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T17:29:56.495268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:30:16.972290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:30:32.020366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:30:49.754297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:30:54.849698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:31:06.245289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:31:09.896984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:31:18.917869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:31:18.917908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:31:18.917925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T17:31:18.917930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T17:31:18.841Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 76 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "09e7cd2b-1867-4d1f-b265-6edadea8d072" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.56:57116 10.132.0.56:443 10.132.0.12:60476 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T17:31:31.250396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:31:41.302285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:31:49.441335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:32:02.885793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:32:05.143266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:32:25.285374Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:32:31.069451Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T17:32:36.168795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8