2026-10-31T12:51:17.600088Z info FLAG: --concurrency="0" 2026-10-31T12:51:17.600109Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T12:51:17.600113Z info FLAG: --help="false" 2026-10-31T12:51:17.600116Z info FLAG: --log_as_json="false" 2026-10-31T12:51:17.600118Z info FLAG: --log_caller="" 2026-10-31T12:51:17.600120Z info FLAG: --log_output_level="default:info" 2026-10-31T12:51:17.600122Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T12:51:17.600126Z info FLAG: --log_target="[stdout]" 2026-10-31T12:51:17.600128Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T12:51:17.600131Z info FLAG: --outlierLogPath="" 2026-10-31T12:51:17.600133Z info FLAG: --profiling="true" 2026-10-31T12:51:17.600135Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T12:51:17.600137Z info FLAG: --proxyLogLevel="warning" 2026-10-31T12:51:17.600139Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T12:51:17.600140Z info FLAG: --stsPort="0" 2026-10-31T12:51:17.600142Z info FLAG: --templateFile="" 2026-10-31T12:51:17.600145Z info FLAG: --tokenManagerPlugin="" 2026-10-31T12:51:17.600147Z info FLAG: --vklog="0" 2026-10-31T12:51:17.600149Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T12:51:17.600301Z info Proxy role ips=[10.132.0.45] type=router id=maas-default-gateway-openshift-default-fc8c56547-5wltg.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T12:51:17.600351Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T12:51:17.601835Z info cpu limit detected as 2, setting concurrency 2026-10-31T12:51:17.602045Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T12:51:17.602056Z info JWT policy is third-party-jwt 2026-10-31T12:51:17.602059Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T12:51:17.603775Z info Starting default Istio SDS Server 2026-10-31T12:51:17.603795Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T12:51:17.603812Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T12:51:17.604042Z info Opening status port 15020 2026-10-31T12:51:17.605009Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T12:51:17.606337Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T12:51:17.607214Z info Starting proxy agent 2026-10-31T12:51:17.607253Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T12:51:17.615982Z info sds Starting SDS grpc server 2026-10-31T12:51:17.616007Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T12:51:17.670941Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T12:51:17.679151Z info cache generated new workload certificate resourceName=default latency=74.320586ms ttl=23h59m59.320851186s 2026-10-31T12:51:17.679181Z info cache Root cert has changed, start rotating root cert 2026-10-31T12:51:17.679211Z info cache returned workload trust anchor from cache ttl=23h59m59.320789399s 2026-10-31T12:51:17.768738Z info ads ADS: new connection for node:1 2026-10-31T12:51:17.768802Z info cache returned workload certificate from cache ttl=23h59m59.231200331s 2026-10-31T12:51:17.769049Z info ads ADS: new connection for node:2 2026-10-31T12:51:17.769114Z info cache returned workload trust anchor from cache ttl=23h59m59.230886698s 2026-10-31T12:51:17.850836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:51:25.714464Z info Readiness succeeded in 8.116765719s 2026-10-31T12:51:25.714869Z info Envoy proxy is ready 2026-10-31T12:51:26.105257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:51:26.105304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:51:26.105322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:51:26.105326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:51:26.008Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 96 - "52.71.36.72,10.132.0.13" "curl/7.76.1" "555985b2-2112-4678-ae5f-4c7c12ea58a3" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:46192 10.132.0.45:443 10.132.0.13:49646 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:54:12.607260Z info ads ADS: new connection for node:3 2026-10-31T12:54:12.622426Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T12:54:12.622853Z info cache read certificate from file resource=file-root:system 2026-10-31T12:54:13.145524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:20.022312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:28.929489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:43.725779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:13.703382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:40.776338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:54.040272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T12:55:58.743Z] "POST /llm/e2e-rt-eq-43bdd0/anything/e2e-rt-eq-43bdd0-client HTTP/1.1" 429 - - "-" 124 18 105 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5c5ad61c-d40e-47fd-a705-09dffad95716" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-43bdd0.llm.svc.cluster.local - 10.132.0.45:443 10.132.0.13:34904 - llm.external-model-e2e-rt-eq-43bdd0-dc669f641903.4 2026-10-31T12:56:22.281574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:23.216500Z info ads ADS: "" 3 terminated 2026-10-31T12:56:23.862376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:38.943743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:57:45.247741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:59:23.481734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T12:59:39.569Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 45 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6831ed55-2d43-43be-82b0-b5ac170a8a7c" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.45:443 10.132.0.13:52928 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:40.474593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:40.474647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:40.474665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:40.474671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T12:59:40.409Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 65 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "29cc3a74-0905-49b6-b2e7-83097113f2a0" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:43024 10.132.0.45:443 10.132.0.13:52942 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:42.671314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T12:59:42.671365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T12:59:42.671394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T12:59:42.671402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T12:59:43.012313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:43.012350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:43.012366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:43.012370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:59:42.556Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 115 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5a904deb-a634-40cc-8476-07ec6d494432" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:48340 10.132.0.45:443 10.132.0.13:52956 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:59:42.858Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 41 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "63c05735-7de7-4d82-a121-b0c682b4a251" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.45:443 10.132.0.13:51080 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:59:42.955Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 311 57 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "03226344-a243-43c0-ad88-882826d466d6" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:43024 10.132.0.45:443 10.132.0.13:51086 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:43.149143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T12:59:43.149177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T12:59:43.149192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T12:59:43.149196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-31T12:59:43.068Z] "DELETE /v1/api-keys/12bb445b-7841-4641-9d91-520f8cb03b09 HTTP/1.1" 200 - via_upstream - "-" 0 321 80 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "0ff18a8e-0864-4b1b-a035-0049243aa933" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:48340 10.132.0.45:443 10.132.0.13:51100 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:59:58.332Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 51 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "59862121-ed21-4691-975f-068daf7e3e59" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.45:443 10.132.0.13:35916 - v1-completions-path 2026-10-31T13:00:08.055862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:00:28.442622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:04:52.239366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:04:52.239401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:04:52.239415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:04:52.239419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T13:04:52.173Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 329 66 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "543f3d40-4784-4643-b4b2-e8bfde464a23" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:46854 10.132.0.45:443 10.132.0.13:39180 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:13:43.103711Z info ads ADS: new connection for node:4 2026-10-31T13:13:43.109767Z info cache read certificate from file resource=file-root:system 2026-10-31T13:20:13.852869Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T13:20:20.966893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:21:02.730124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:22:05.780770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:22:24.956871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:03.960186Z info ads ADS: new connection for node:5 2026-10-31T13:23:03.960492Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:23:03.960869Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:23:22.748785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:27.379046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:23:27.379083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:23:27.379098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:23:27.379102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T13:23:27.288Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 90 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6b2ebe90-5ad9-4d91-8238-dcd1de12a78a" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:38066 10.132.0.45:443 10.132.0.13:49364 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:23:40.404789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:24:05.779855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:26:41.853721Z info ads ADS: "" 5 terminated with stream closed 2026-10-31T13:30:09.681023Z info ads ADS: "" 4 terminated with stream closed 2026-10-31T13:33:39.091002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:35:25.175791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:36:51.311783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:37:32.724010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:38:49.265810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:39:20.051433Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-31T13:47:43.437911Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T13:48:00.836857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:24.730693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:57.342132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:49:00.650Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 73 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "a9a87d42-1aae-44ab-ad03-78476d9db6dd" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:34746 10.132.0.45:443 10.132.0.13:33038 - v1-chat-completions-path 2026-10-31T13:49:01.930783Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=5 2026-10-31T13:49:12.829288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:14.768455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:49:17.555Z] "POST /v1/embeddings HTTP/1.1" 500 - response_payload_too_large - "-" 28720 21 190 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ff1c9b98-5460-48af-a74d-ecccccf6a9dd" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:44110 10.132.0.45:443 10.132.0.13:60162 - v1-catch-all-path 2026-10-31T13:49:20.849145Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:35.953416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:37.744191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:43.567336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:02.830387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:04.629057Z info ads ADS: new connection for node:6 2026-10-31T13:50:04.629377Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:50:04.629474Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:50:06.132715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:46.851089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:05.844547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:05.947709Z info ads ADS: "" 6 terminated with stream closed 2026-10-31T13:51:07.726102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:10.095026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:14.276104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:53:23.758649Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-10-31T13:53:23.820017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:53:23.820049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:53:23.820063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T13:53:23.820067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-31T13:53:23.751Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 68 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "fa5facad-db2c-46fd-9c8a-0e078d53e2af" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:42670 10.132.0.45:443 10.132.0.13:59768 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:53:27.126477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:53:46.120120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:00.264052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:11.965504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:15.500778Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:26.684661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:29.045439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:44.191816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:55:29.251652Z info ads ADS: new connection for node:7 2026-10-31T13:55:29.256387Z info cache read certificate from file resource=file-root:system 2026-10-31T13:55:29.867675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:55:31.431188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:56:31.092993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T13:56:31.167714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:31.167747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:31.167759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:31.167763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:56:31.167934Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T13:56:31.030Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1696 137 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6c992193-7f2c-4926-ae02-805cb2f76d0e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.45:60426 10.132.0.45:443 10.132.0.13:51826 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:56:37.637191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:56:37.637224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:56:37.637236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T13:56:37.637240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:56:37.637398Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-31T13:56:37.521Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1700 115 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "bcfe1034-3ac6-40ff-ae25-b045548a81c4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.45:44648 10.132.0.45:443 10.132.0.13:36050 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:57:07.903175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:08.043083Z info ads ADS: "" 7 terminated 2026-10-31T13:57:08.356514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:57:08.356550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:57:08.356567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:57:08.356572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T13:57:08.460576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:08.940888Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T13:57:08.940916Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T13:57:08.940920Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T13:57:08.940925Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 2026-10-31T13:57:11.101518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:57:08.271Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 84 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "474d264d-5ab6-4c9b-8834-23bdbc351faf" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:52062 10.132.0.45:443 10.132.0.13:36136 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:57:08.896Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 44 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ab5b8868-5858-4beb-95c0-e3e82e9f6aa4" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.45:443 10.132.0.13:36144 - v1-completions-path 2026-10-31T13:57:13.415678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:28.759595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:30.434956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:44.995129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:46.737056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:49.465335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:57.856141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:58:05.295Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ca4f43be-47cb-4780-9b3d-2922186d94a7" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:38528 10.132.0.45:443 10.132.0.13:53858 - v1-completions-path [2026-10-31T13:58:06.221Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 53 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "66bd1b3b-c564-42ac-97ff-2a54b40e1bb3" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:38528 10.132.0.45:443 10.132.0.13:53884 - v1-completions-path [2026-10-31T13:58:06.659Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "4324a0c2-b187-48c8-9fde-5599db033f26" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:38528 10.132.0.45:443 10.132.0.13:53898 - v1-completions-path [2026-10-31T13:58:06.772Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "49630e1e-9595-4cd8-9521-9fbccff0fd02" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:38528 10.132.0.45:443 10.132.0.13:53904 - v1-completions-path [2026-10-31T13:58:07.385Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "105181b5-f183-4980-b5e2-952a7e73bdd2" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:38532 10.132.0.45:443 10.132.0.13:53912 - v1-completions-path 2026-10-31T13:58:22.233595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:32.536551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:36.409570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:52.436623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:54.119459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:56.894791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:58:56.894832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:58:56.894850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:58:56.894857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T13:58:56.827Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 67 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c9ed3ab7-9172-407b-977c-65cb0b1a8311" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:46058 10.132.0.45:443 10.132.0.13:53922 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:58:59.633569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:59:08.450Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 79 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e0f85260-4eeb-4b35-bf04-54bccd425fb6" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:52172 10.132.0.45:443 10.132.0.13:54308 - v1-completions-path 2026-10-31T13:59:10.483585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:24.237280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:25.948930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:31.339166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:59:37.975Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 67 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6457abc6-ef18-4c81-a977-0546e8dbfed8" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:52172 10.132.0.45:443 10.132.0.13:37670 - v1-completions-path 2026-10-31T13:59:49.529091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:52.149202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:00:05.522Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 37 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "cd907bb1-7c94-4ef8-9103-86e541ba1d56" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.45:443 10.132.0.13:45500 - v1-completions-path 2026-10-31T14:00:07.198647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:09.349652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:09.976428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:09.976472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:09.976489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:09.976494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T14:00:09.910Z] "DELETE /v1/api-keys/62e00033-f587-4163-868e-55aa73a43728 HTTP/1.1" 200 - via_upstream - "-" 0 375 66 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7c273707-4b90-4e66-abe8-511fa52aae01" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:48872 10.132.0.45:443 10.132.0.13:45510 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:00:14.140836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:16.961798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:16.961841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:16.961860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:16.961867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T14:00:16.895Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 66 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "18313de7-492b-4829-b733-f07e06f4aa79" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:48872 10.132.0.45:443 10.132.0.13:40404 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:00:28.971296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:39.218031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:54.968424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:57.276122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:03:12.408480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:03:14.716840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:17.426480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:04:17.426519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:04:17.426535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T14:04:17.426539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T14:04:17.351Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 75 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1f929287-54c6-43fd-9f52-6a177bca3e74" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:37480 10.132.0.45:443 10.132.0.13:55764 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:04:39.556570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:54.646533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:56.301822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:02.028422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:20.633912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:24.537990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:05:27.547Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "91405d24-4e29-4965-8ac5-bc53cbd067a9" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:38528 10.132.0.45:443 10.132.0.13:55596 - v1-completions-path [2026-10-31T14:05:27.669Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "cb06d5cb-07a2-4832-a420-d6885808da55" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:38532 10.132.0.45:443 10.132.0.13:55610 - v1-completions-path 2026-10-31T14:05:29.342558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T14:05:29.342602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T14:05:29.342623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T14:05:29.342658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T14:05:29.267Z] "DELETE /v1/api-keys/d1cb0933-1da5-4f0f-aca4-de9da49cf8a3 HTTP/1.1" 200 - via_upstream - "-" 0 369 75 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "b78d8f11-af6f-4143-a4a4-e3266e30935b" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.1.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.45:60720 10.132.0.45:443 10.132.0.13:55630 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:05:40.011730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:50.560000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:52.855590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:05:58.416Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "37e2361a-3bdf-442b-ba47-1bcf1b6cce28" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.45:443 10.132.0.13:39670 - v1-completions-path 2026-10-31T14:06:10.377559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:12.555214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:15.487375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:06:24.768Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "f3eb49ad-1a2b-45c3-afcf-2b7b5917e63b" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.45:443 10.132.0.13:42390 - v1-completions-path 2026-10-31T14:06:36.486471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:46.805947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:48.840667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:52.246741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:57.251094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:07:00.109Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "985878d3-60e0-4515-9840-6c30ccce8ff4" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.45:38532 10.132.0.45:443 10.132.0.13:45746 - v1-completions-path 2026-10-31T14:07:13.283416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:23.548094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:25.167053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:35.431823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:38.300761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:41.566247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:58.594880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:18.454258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:28.731155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:38.967501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:49.167429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:59.494821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:09.719996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:19.872985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:30.108504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:40.319891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:50.588935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8