2026-10-30T13:11:21.913434Z info FLAG: --concurrency="0" 2026-10-30T13:11:21.913452Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T13:11:21.913456Z info FLAG: --help="false" 2026-10-30T13:11:21.913458Z info FLAG: --log_as_json="false" 2026-10-30T13:11:21.913460Z info FLAG: --log_caller="" 2026-10-30T13:11:21.913462Z info FLAG: --log_output_level="default:info" 2026-10-30T13:11:21.913465Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T13:11:21.913469Z info FLAG: --log_target="[stdout]" 2026-10-30T13:11:21.913471Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T13:11:21.913473Z info FLAG: --outlierLogPath="" 2026-10-30T13:11:21.913475Z info FLAG: --profiling="true" 2026-10-30T13:11:21.913478Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T13:11:21.913480Z info FLAG: --proxyLogLevel="warning" 2026-10-30T13:11:21.913482Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T13:11:21.913484Z info FLAG: --stsPort="0" 2026-10-30T13:11:21.913486Z info FLAG: --templateFile="" 2026-10-30T13:11:21.913488Z info FLAG: --tokenManagerPlugin="" 2026-10-30T13:11:21.913491Z info FLAG: --vklog="0" 2026-10-30T13:11:21.913493Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T13:11:21.913638Z info Proxy role ips=[10.132.0.49] type=router id=maas-default-gateway-openshift-default-c9ffffc7f-xs2vr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T13:11:21.913686Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T13:11:21.914682Z info cpu limit detected as 2, setting concurrency 2026-10-30T13:11:21.914876Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T13:11:21.914888Z info JWT policy is third-party-jwt 2026-10-30T13:11:21.914891Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T13:11:21.916065Z info Starting default Istio SDS Server 2026-10-30T13:11:21.916089Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T13:11:21.916112Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T13:11:21.916620Z info Opening status port 15020 2026-10-30T13:11:21.916951Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T13:11:21.917485Z info sds Starting SDS grpc server 2026-10-30T13:11:21.917500Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T13:11:21.918643Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T13:11:21.921462Z info Starting proxy agent 2026-10-30T13:11:21.921560Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T13:11:21.982460Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T13:11:22.013043Z info cache generated new workload certificate resourceName=default latency=95.471864ms ttl=23h59m59.986959671s 2026-10-30T13:11:22.013074Z info cache Root cert has changed, start rotating root cert 2026-10-30T13:11:22.013103Z info cache returned workload trust anchor from cache ttl=23h59m59.986897681s 2026-10-30T13:11:22.091179Z info ads ADS: new connection for node:1 2026-10-30T13:11:22.091239Z info cache returned workload certificate from cache ttl=23h59m59.908762615s 2026-10-30T13:11:22.091395Z info ads ADS: new connection for node:2 2026-10-30T13:11:22.091461Z info cache returned workload trust anchor from cache ttl=23h59m59.908540297s 2026-10-30T13:11:22.169657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:11:30.126369Z info Readiness succeeded in 8.215305206s 2026-10-30T13:11:30.126805Z info Envoy proxy is ready 2026-10-30T13:11:35.815504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:12:41.527794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:12:41.527828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:12:41.527839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:12:41.527844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:12:41.507Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 20 - "52.71.36.72,10.132.0.22" "curl/7.76.1" "170604fd-3fb9-4e6f-a8ab-af80e8126623" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:46994 10.132.0.49:443 10.132.0.22:49082 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T13:15:20.028786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:15:20.028823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:15:20.028838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:15:20.028843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T13:15:19.883Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 48 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "4ed5f98b-348c-465d-ae35-1bf49dcce673" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.49:443 10.132.0.22:36186 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:15:19.956Z] "DELETE /v1/api-keys/c9e980a4-6528-466f-9e13-a2fead2ec695 HTTP/1.1" 200 - via_upstream - "-" 0 370 72 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "f0e36adc-a64d-4079-b1c0-80cfa9ef09c7" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:51928 10.132.0.49:443 10.132.0.22:36202 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:15:22.263224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:15:22.263392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:15:22.263453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:15:22.263487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:15:22.023Z] "DELETE /v1/api-keys/e9bcea96-2da4-40e0-aefa-3ac793bbc3af HTTP/1.1" 200 - via_upstream - "-" 0 321 240 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "75a44725-8007-4d9a-a269-d55b51f2eef9" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:51928 10.132.0.49:443 10.132.0.22:57398 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:15:22.293Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 143 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "01289113-2dfd-4deb-b1d1-ad6542dcd826" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.49:443 10.132.0.22:57412 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:15:22.792753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:22.792867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:22.792932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:22.792961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:15:23.348344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:23.348382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:23.348400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:15:23.348405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T13:15:22.464Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 328 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "17746b42-2278-4afd-a01c-68797a1cbbcb" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:38132 10.132.0.49:443 10.132.0.22:57428 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:15:23.185Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 163 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "ca5a6e3f-d001-466f-982f-3730bfa2fbe4" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:38132 10.132.0.49:443 10.132.0.22:57436 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:15:24.599225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:15:24.599288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:15:24.599305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:15:24.599310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:15:24.496Z] "DELETE /v1/api-keys/6686d6c1-463b-4b2a-9665-74152ad14e6a HTTP/1.1" 200 - via_upstream - "-" 0 321 102 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "8e592d3b-b711-4ff9-b47e-027d045c1543" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:51928 10.132.0.49:443 10.132.0.22:57442 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:15:24.617Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 78 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "74ead33b-fe98-48b1-98e0-0565e98d3fae" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.49:443 10.132.0.22:57448 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:15:24.958220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:24.958253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:24.958305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:15:24.958312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T13:15:24.856Z] "DELETE /v1/api-keys/507d53f4-881f-426b-8fee-716e62747883 HTTP/1.1" 200 - via_upstream - "-" 0 321 102 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "954cb173-f9ef-4f0a-a44e-e02bcc72937f" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:38132 10.132.0.49:443 10.132.0.22:57452 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:15:26.714Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 136 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "d0bbd9ab-60eb-4a5f-b766-028acbafd308" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:46194 10.132.0.49:443 10.132.0.22:57474 - v1-completions-path [2026-10-30T13:15:27.580Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 11 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "0144a871-096e-47d9-b992-86ea7a78588d" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.49:443 10.132.0.22:57490 - - 2026-10-30T13:15:32.953711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T13:15:33.020717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:33.020751Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:33.020766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:15:33.020771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:15:32.947Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 72 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "b2ce53a1-8fa4-45e6-88d9-f3e501d678b9" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:38132 10.132.0.49:443 10.132.0.22:35648 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:15:37.657389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:15:54.164880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:21:58.609692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:21:58.609725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:21:58.609739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:21:58.609744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:21:59.065035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:21:58.535Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 74 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "4cb02876-4024-480f-a8b3-0d65cc32deba" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:41292 10.132.0.49:443 10.132.0.22:59538 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:22:23.535118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:23:30.959596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:23:35.932Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "61416a35-2ad5-4b33-a169-befa2ff7e276" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.22:58564 - v1-completions-path 2026-10-30T13:23:47.948603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:23:52.414970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:23:55.829Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "7b4b4d2c-fe94-4b4f-b767-1e2e8d7dd970" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.22:34972 - v1-completions-path 2026-10-30T13:24:08.015481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:33.747256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:24:39.404Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "b64e7246-d63a-44dd-ae53-cd4a2391a42c" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:47902 10.132.0.49:443 10.132.0.22:49384 - v1-completions-path [2026-10-30T13:24:39.598Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "fc84e5cc-8bb5-46d5-8f2d-5dc38200b506" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:47902 10.132.0.49:443 10.132.0.22:49400 - v1-completions-path 2026-10-30T13:24:41.086648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T13:24:40.718Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "4f1304d5-4dc1-4314-81ca-637ee0e87ab3" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:47902 10.132.0.49:443 10.132.0.22:49412 - v1-completions-path [2026-10-30T13:24:41.034Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "ba046fc2-1289-4ff8-a565-9644c9508357" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:47904 10.132.0.49:443 10.132.0.22:49426 - v1-completions-path 2026-10-30T13:24:57.157292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:07.507824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:11.967639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:25:21.234Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "690590c9-e6eb-4bd9-95a2-d507255645c5" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:47904 10.132.0.49:443 10.132.0.22:38052 - v1-completions-path [2026-10-30T13:25:21.779Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 56 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "da305aad-3527-4745-acce-57b3d4042c8e" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:47904 10.132.0.49:443 10.132.0.22:56384 - v1-completions-path 2026-10-30T13:25:33.892061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:36.303155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:43.403524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:25:43.403565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:25:43.403585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:25:43.403591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:25:43.327Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 76 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "c29172f3-ad41-4442-a027-fe8409dfe07c" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:52876 10.132.0.49:443 10.132.0.22:56556 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:25:55.435971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:25:59.848249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:26:16.525360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:26:33.672811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:26:45.493207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:26:48.848770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:27:06.810645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:27:09.715717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:27:18.890543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:27:18.890575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:27:18.890588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:27:18.890593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T13:27:18.816Z] "DELETE /v1/api-keys/c7a3576e-d0c1-4da4-972d-3a0d5a7fb9d2 HTTP/1.1" 404 - via_upstream - "-" 0 29 74 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "b29fe153-31ac-45c8-b5f3-0eb4ee576bc0" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:54752 10.132.0.49:443 10.132.0.22:37504 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:27:34.451082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:27:37.213387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:29:34.881123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:29:37.457317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:30:59.499704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:30:59.499738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:30:59.499753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:30:59.499757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T13:30:59.423Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 311 76 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "387c3e7c-2141-4cac-b4e1-94e1901a14ca" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:38244 10.132.0.49:443 10.132.0.22:47986 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:31:19.391159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:31:34.395938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:31:36.720695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:31:51.307882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:34:04.398884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:34:21.498245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:34:35.573524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:34:35.573557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:34:35.573574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:34:35.573579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:34:35.496Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 76 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "524e7f23-baeb-40f1-8bf6-00f616ee5d49" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:48016 10.132.0.49:443 10.132.0.22:37452 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:34:37.772671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:34:49.764640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:34:53.206572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:34:53.206605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:34:53.206617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:34:53.206622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:34:53.681333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:34:53.149Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 57 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "13ad63ef-1f2d-4f86-882a-eeee154768f9" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:48016 10.132.0.49:443 10.132.0.22:32800 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:35:05.132764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:35:18.594870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:35:23.381Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "fd8af316-02f1-4f65-989a-1c63e881163b" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:47902 10.132.0.49:443 10.132.0.22:44046 - v1-completions-path [2026-10-30T13:35:23.466Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 51 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "faea3579-0967-4a37-b0b5-6aae4294d0cb" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.22:44060 - v1-completions-path 2026-10-30T13:35:35.575065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:35:40.471983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:35:45.866409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:35:45.866446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:35:45.866462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:35:45.866467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:35:45.789Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 76 - "52.71.36.72,10.132.0.22" "python-requests/2.34.2" "35ed0031-c6f1-40bc-a357-1a92146c5507" "maas.apps.03ade695efcb3fb1e0e7.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:46594 10.132.0.49:443 10.132.0.22:57872 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:35:58.677032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:36:16.701091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:36:19.051016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:36:33.847901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:36:44.809662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8