2026-10-30T06:37:36.634654Z info FLAG: --concurrency="0" 2026-10-30T06:37:36.634675Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T06:37:36.634681Z info FLAG: --help="false" 2026-10-30T06:37:36.634684Z info FLAG: --log_as_json="false" 2026-10-30T06:37:36.634687Z info FLAG: --log_caller="" 2026-10-30T06:37:36.634690Z info FLAG: --log_output_level="default:info" 2026-10-30T06:37:36.634693Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T06:37:36.634699Z info FLAG: --log_target="[stdout]" 2026-10-30T06:37:36.634703Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T06:37:36.634706Z info FLAG: --outlierLogPath="" 2026-10-30T06:37:36.634709Z info FLAG: --profiling="true" 2026-10-30T06:37:36.634712Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T06:37:36.634715Z info FLAG: --proxyLogLevel="warning" 2026-10-30T06:37:36.634718Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T06:37:36.634722Z info FLAG: --stsPort="0" 2026-10-30T06:37:36.634724Z info FLAG: --templateFile="" 2026-10-30T06:37:36.634727Z info FLAG: --tokenManagerPlugin="" 2026-10-30T06:37:36.634731Z info FLAG: --vklog="0" 2026-10-30T06:37:36.634735Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T06:37:36.634920Z info Proxy role ips=[10.134.0.21] type=router id=maas-default-gateway-openshift-default-67bf986f99-qgpg5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T06:37:36.635005Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T06:37:36.636182Z info cpu limit detected as 2, setting concurrency 2026-10-30T06:37:36.636494Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T06:37:36.636505Z info JWT policy is third-party-jwt 2026-10-30T06:37:36.636509Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T06:37:36.638610Z info Starting default Istio SDS Server 2026-10-30T06:37:36.638629Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T06:37:36.638646Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T06:37:36.638898Z info Opening status port 15020 2026-10-30T06:37:36.639706Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T06:37:36.640259Z info sds Starting SDS grpc server 2026-10-30T06:37:36.640276Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T06:37:36.641141Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T06:37:36.641960Z info Starting proxy agent 2026-10-30T06:37:36.641989Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T06:37:36.713400Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T06:37:36.813896Z info ads ADS: new connection for node:1 2026-10-30T06:37:36.814347Z info ads ADS: new connection for node:2 2026-10-30T06:37:36.849506Z info cache generated new workload certificate resourceName=default latency=209.09691ms ttl=23h59m59.150496454s 2026-10-30T06:37:36.849537Z info cache Root cert has changed, start rotating root cert 2026-10-30T06:37:36.849570Z info cache returned workload certificate from cache ttl=23h59m59.150435388s 2026-10-30T06:37:36.849577Z info cache returned workload trust anchor from cache ttl=23h59m59.150423458s 2026-10-30T06:37:36.849679Z info cache returned workload trust anchor from cache ttl=23h59m59.15032178s 2026-10-30T06:37:36.850036Z info cache returned workload trust anchor from cache ttl=23h59m59.149965104s 2026-10-30T06:37:36.891768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:37:43.455735Z info Readiness succeeded in 6.824485682s 2026-10-30T06:37:43.456083Z info Envoy proxy is ready 2026-10-30T06:38:16.261309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:38:17.420378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:38:49.311810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:38:53.586972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:38:55.954609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:38:59.726000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:39:02.185442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:39:06.162540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:39:10.551225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:39:29.937720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:39:29.937761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:39:29.937776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T06:39:29.937781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T06:39:29.833Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 104 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "ee4d9122-3c98-46c9-a2d8-f8b98e898702" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:45264 10.134.0.21:443 10.132.0.11:49978 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T06:39:30.134Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 546 83 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "c23ef519-c802-4b5d-9ffa-f77339b890b7" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:33196 10.134.0.21:443 10.132.0.11:49988 - v1-model-routing [2026-10-30T06:39:30.317Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 512 57 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "28c35bc0-efa9-4c83-a35c-59ee2986f75d" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:33196 10.134.0.21:443 10.132.0.11:49992 - v1-model-routing 2026-10-30T06:45:46.413046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:46:16.957058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:48:01.643990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:48:30.801003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:48:48.877Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 45 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "93c6de73-172c-4702-861d-b79be25cdaa7" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.21:443 10.132.0.11:33516 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:48:51.394441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:48:51.394492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:48:51.394515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T06:48:51.394523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T06:48:51.232Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 161 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9cd29870-f2ea-4e7b-8e8d-8950bff45959" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:37158 10.134.0.21:443 10.132.0.11:33528 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T06:49:01.132Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 65 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "086bd227-ba1e-4223-9f76-d8cc691f5cc3" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:59110 10.134.0.21:443 10.132.0.11:57964 - v1-completions-path 2026-10-30T06:49:21.697136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:49:33.762181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:49:33.762220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:49:33.762236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:49:33.762243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T06:49:33.744Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 17 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "e50fba37-36b2-48f0-995b-bd45840a1573" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:51628 10.134.0.21:443 10.132.0.11:54310 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T06:49:43.719425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:53:36.635046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T06:53:36.556Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 321 80 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "24c7b734-0907-4991-8a50-bfb1edc703b3" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:33196 10.134.0.21:443 10.132.0.11:39978 - v1-chat-completions-path 2026-10-30T06:57:52.551591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:57:52.551632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:57:52.551654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:57:52.551660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T06:57:53.066178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:57:53.066213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:57:53.066228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:57:53.066233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T06:57:53.066402Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-30T06:57:53.066457Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:57:53.066465Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:57:53.066467Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T06:57:53.066471Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T06:57:52.445Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 106 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f614e078-6fcc-4101-b26a-94d159569537" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:42800 10.134.0.21:443 10.132.0.11:38454 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T06:57:52.979Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 126 129 87 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "1293b66c-3964-47fa-8651-1baaa61f2468" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:33196 10.134.0.21:443 10.132.0.11:38460 - v1-chat-completions-path [2026-10-30T06:58:45.244Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 35 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "539a418c-a2a7-4d4a-8473-77f80f2304d4" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.21:443 10.132.0.11:36052 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:05:59.005069Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T07:08:24.739216Z info ads ADS: new connection for node:3 2026-10-30T07:08:24.745477Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T07:08:24.745626Z info cache read certificate from file resource=file-root:system 2026-10-30T07:10:39.696968Z info ads ADS: "" 3 terminated 2026-10-30T07:10:40.893624Z info ads ADS: new connection for node:4 2026-10-30T07:10:40.908592Z info cache read certificate from file resource=file-root:system 2026-10-30T07:14:21.600051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:14:45.317521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:14:47.567695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:14:47.567740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:14:47.567760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:14:47.567767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T07:14:47.468Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 99 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "bd155812-8474-42b1-bd00-a5c00aca69f5" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:56436 10.134.0.21:443 10.132.0.11:37472 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:15:19.244758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:15:56.667067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:16:19.671028Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:16:22.955177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:16:22.955218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:16:22.955239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:16:22.955245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T07:16:22.857Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 98 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "b3ffbe82-199c-41c0-b5d0-f3c5fbe949b7" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:55004 10.134.0.21:443 10.132.0.11:56894 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:16:35.314223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:16:40.830898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:16:59.276976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:17:33.130025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:17:47.954967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:18:17.548899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:18:38.071541Z info ads ADS: new connection for node:5 2026-10-30T07:18:38.071691Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:18:38.071715Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:20:26.552644Z info ads ADS: "" 5 terminated 2026-10-30T07:20:51.111117Z info ads ADS: "" 4 terminated with stream closed 2026-10-30T07:28:13.220096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:29:24.027038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:31:05.922099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:33:01.970035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:36:58.247983Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T07:42:03.734469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:42:03.734502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:42:03.734515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:42:03.734520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T07:42:03.631Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 103 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "7173495b-7aba-494f-a727-7f56d0c6c54a" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:52738 10.134.0.21:443 10.132.0.11:56760 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:42:07.667839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:42:09.550287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:42:09.550324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:42:09.550338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:42:09.550342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T07:42:08.407Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 1143 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "4e44d65d-101b-4568-8050-7f93fd07ea71" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:52746 10.134.0.21:443 10.132.0.11:56778 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:42:31.562491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:05.340262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:22.163965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:25.119818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:35.482978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:53.604348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:55.900515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:44:10.626710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:44:21.650041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:44:24.152081Z info ads ADS: new connection for node:6 2026-10-30T07:44:24.152262Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:44:28.044853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:45:06.648132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:45:09.875Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 331 99 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "09b1d084-9399-4518-8f42-0569fdfff9b3" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.61:8000" outbound|54321||e2e-prio-pool-74f9b463-inference-pool-ip-f42fb901.llm.svc.cluster.local 10.134.0.21:60614 10.134.0.21:443 10.132.0.11:38374 - v1-model-routing 2026-10-30T07:45:12.069658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T07:45:12.005Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 343 65 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "82a3a888-c841-4c46-b1e9-add24f15a61b" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.61:8000" outbound|54321||e2e-prio-pool-74f9b463-inference-pool-ip-f42fb901.llm.svc.cluster.local 10.134.0.21:59958 10.134.0.21:443 10.132.0.11:38376 - v1-model-routing 2026-10-30T07:45:26.176024Z info ads ADS: "" 6 terminated with stream closed 2026-10-30T07:45:26.254576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:45:28.591767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:45:31.455794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:45:36.854836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:13.126728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:29.708704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:45.458416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:57.454735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:01.628204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:12.796760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:17.207640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:35.678648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:48:53.204Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 65 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "5baf38d9-427b-93e1-93a7-4ba83a08b4c6" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:33196 10.134.0.21:443 10.132.0.11:56740 - v1-completions-path 2026-10-30T07:49:26.406846Z info ads ADS: new connection for node:7 2026-10-30T07:49:26.410521Z info cache read certificate from file resource=file-root:system 2026-10-30T07:49:27.573687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:30.115195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:32.833434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:49:32.833473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:49:32.833487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:49:32.833492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T07:49:32.676Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 157 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "097d3355-390d-9aa4-b6f9-40dc682810d1" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:33262 10.134.0.21:443 10.132.0.11:38360 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:49:48.131927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:49:48.131982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:49:48.131991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:49:48.131995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:49:48.132140Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:49:48.021Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1729 110 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "c18d10b7-d677-46fd-9175-72ebd9ce0fc7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.21:56232 10.134.0.21:443 10.132.0.11:35400 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:50:03.151494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:50:03.151524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:50:03.151535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:50:03.151539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:50:03.151681Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:50:03.052Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1733 99 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "8bb6862e-adb5-451d-9c95-01c4bd71e1b1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.21:56232 10.134.0.21:443 10.132.0.11:59784 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:50:22.334904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:50:22.334966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:50:22.334980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:50:22.334984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:50:22.335134Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:50:22.235Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1734 99 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "560ff5de-33bf-498c-9813-4e30f460833d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.21:56232 10.134.0.21:443 10.132.0.11:60214 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:50:55.195452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:55.275237Z info ads ADS: "" 7 terminated 2026-10-30T07:50:55.739910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:58.927624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:04.153078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:24.034025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:28.359889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:51:31.845Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 70 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "c5c5597c-d847-4014-bc26-be1ee56b5e31" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:45356 10.134.0.21:443 10.132.0.11:47766 - v1-completions-path [2026-10-30T07:51:32.115Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 54 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "5c9a3a59-e236-4c0c-aec1-dab4ddd922ed" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.21:443 10.132.0.11:47772 - v1-completions-path 2026-10-30T07:51:44.250869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:00.107536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:52:06.608Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 61 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "0eae1ff7-766e-4d8b-ad9f-deb1d34aaf4c" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:45356 10.134.0.21:443 10.132.0.11:58508 - v1-completions-path [2026-10-30T07:52:07.682Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "d705cd40-eaef-4540-af9c-8cc01981c700" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:53854 10.134.0.21:443 10.132.0.11:58512 - v1-completions-path 2026-10-30T07:52:23.653746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:34.016194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:38.727078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:55.748784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:57.997327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:17.094725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:53:19.022Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 65 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "ece00c9b-aa99-4a08-9621-33e53ff87932" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:33196 10.134.0.21:443 10.132.0.11:35362 - v1-completions-path 2026-10-30T07:53:21.677988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:37.267144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:39.634777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:57.533532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:09.194314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:13.013867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:54:35.924Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 32 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "de2b548d-0ff8-4d53-96c4-8f13e9690a89" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.21:443 10.132.0.11:45686 - v1-completions-path 2026-10-30T07:54:41.256534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:47.066516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:47.066555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:47.066571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:54:47.066576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T07:54:46.988Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 77 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "75eac82f-f156-4c54-a35c-9813f0f45fdd" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:59702 10.134.0.21:443 10.132.0.11:42084 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:54:59.444580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:55:09.804810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:56:58.745265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:56:58.745302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:56:58.745316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:56:58.745321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T07:56:58.662Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 82 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "e34a84f0-03b2-43f6-b416-0a2389fff6cb" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.21:45742 10.134.0.21:443 10.132.0.11:54472 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:57:11.565183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:15.224871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:46.441619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:58:49.478Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 289 75 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "6e40b5c8-a905-44f5-bd2e-6880bc8e572c" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:46720 10.134.0.21:443 10.132.0.11:35046 - v1-completions-path 2026-10-30T07:59:02.351357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:04.741314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:23.696793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:36.085382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:39.430330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:55.570172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:06.116679Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:11.176841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:28.045033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:32.733916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:35.671049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T08:00:44.938Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "3512fe5e-2c8d-44f2-8168-e538284a83af" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.21:53854 10.134.0.21:443 10.132.0.11:56878 - v1-completions-path 2026-10-30T08:00:53.197215Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-30T08:00:58.881975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:09.169858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:13.752586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:17.159077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:22.113182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:40.385299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:50.852816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:53.200327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:03.353581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:08.132167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:24.798476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:44.708715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:55.125139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:05.603380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:15.961846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:26.278594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:36.647678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:47.005650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:57.213165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:07.647576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:18.180497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8