2026-11-03T15:09:13.540054Z info FLAG: --concurrency="0" 2026-11-03T15:09:13.540275Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T15:09:13.540306Z info FLAG: --help="false" 2026-11-03T15:09:13.540328Z info FLAG: --log_as_json="false" 2026-11-03T15:09:13.540349Z info FLAG: --log_caller="" 2026-11-03T15:09:13.540369Z info FLAG: --log_output_level="default:info" 2026-11-03T15:09:13.540390Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T15:09:13.540414Z info FLAG: --log_target="[stdout]" 2026-11-03T15:09:13.540435Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T15:09:13.540455Z info FLAG: --outlierLogPath="" 2026-11-03T15:09:13.540475Z info FLAG: --profiling="true" 2026-11-03T15:09:13.540495Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T15:09:13.540515Z info FLAG: --proxyLogLevel="warning" 2026-11-03T15:09:13.540535Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T15:09:13.540556Z info FLAG: --stsPort="0" 2026-11-03T15:09:13.540575Z info FLAG: --templateFile="" 2026-11-03T15:09:13.540595Z info FLAG: --tokenManagerPlugin="" 2026-11-03T15:09:13.540624Z info FLAG: --vklog="0" 2026-11-03T15:09:13.540645Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T15:09:13.540880Z info Proxy role ips=[10.132.1.150] type=router id=maas-default-gateway-openshift-default-855f9574cf-xpvp8.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T15:09:13.541025Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T15:09:13.543524Z info cpu limit detected as 2, setting concurrency 2026-11-03T15:09:13.544017Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T15:09:13.544130Z info JWT policy is third-party-jwt 2026-11-03T15:09:13.544157Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T15:09:13.546819Z info Starting default Istio SDS Server 2026-11-03T15:09:13.546904Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T15:09:13.546983Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T15:09:13.547532Z info Opening status port 15020 2026-11-03T15:09:13.548997Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T15:09:13.550462Z info sds Starting SDS grpc server 2026-11-03T15:09:13.550558Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T15:09:13.550912Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T15:09:13.552183Z info Starting proxy agent 2026-11-03T15:09:13.552271Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T15:09:13.663242Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T15:09:13.696119Z info cache generated new workload certificate resourceName=default latency=145.459959ms ttl=23h59m59.303887189s 2026-11-03T15:09:13.696169Z info cache Root cert has changed, start rotating root cert 2026-11-03T15:09:13.696216Z info cache returned workload trust anchor from cache ttl=23h59m59.303784771s 2026-11-03T15:09:13.830177Z info ads ADS: new connection for node:1 2026-11-03T15:09:13.830260Z info cache returned workload certificate from cache ttl=23h59m59.169743563s 2026-11-03T15:09:13.830541Z info ads ADS: new connection for node:2 2026-11-03T15:09:13.830625Z info cache returned workload trust anchor from cache ttl=23h59m59.169376387s 2026-11-03T15:09:13.928116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:09:21.933493Z info Readiness succeeded in 8.400056051s 2026-11-03T15:09:21.933861Z info Envoy proxy is ready 2026-11-03T15:09:27.553084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:09:39.238595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:09:42.773821Z info ads ADS: new connection for node:3 2026-11-03T15:09:42.774053Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T15:09:42.774090Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T15:09:46.312040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:10:30.641465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:10:35.113Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 331 113 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "8fc3c223-8abb-4952-88ca-e100e6095d1c" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.132.1.153:8000" outbound|54321||e2e-prio-pool-3b12e11b-inference-pool-ip-f5e5c752.llm.svc.cluster.local 10.132.1.150:47642 10.132.1.150:443 10.132.0.14:39560 - v1-model-routing [2026-11-03T15:10:37.461Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 335 60 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "c9388deb-db70-4b55-9e1f-b0dd821992ea" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.132.1.153:8000" outbound|54321||e2e-prio-pool-3b12e11b-inference-pool-ip-f5e5c752.llm.svc.cluster.local 10.132.1.150:47644 10.132.1.150:443 10.132.0.14:39570 - v1-model-routing 2026-11-03T15:10:55.395667Z info ads ADS: "" 3 terminated 2026-11-03T15:10:55.444829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:11:00.396242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:11:00.395Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 116 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "d55076a1-cb70-4647-be0a-de91c2c66ab3" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:43928 10.132.1.150:443 10.132.0.14:52926 - v1-completions-path 2026-11-03T15:11:14.361923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:13:52.593024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:14:23.231633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:14:54.361633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:15:09.853290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:15:22.018009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:15:36.578172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:15:40.324Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 75 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b9ef9b44-128a-438b-a5ec-ba6fffbb6c6c" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55500 10.132.1.150:443 10.132.0.14:46804 - v1-completions-path [2026-11-03T15:15:41.419Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "d248b44b-c11f-4eb4-9ef6-5bb7e9a9c5ac" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55502 10.132.1.150:443 10.132.0.14:46812 - v1-completions-path 2026-11-03T15:15:43.781625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:16:01.804102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:16:04.003141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:16:04.003180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:16:04.003194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:16:04.003199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T15:16:03.888Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 114 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0c46ae24-f04e-4253-a327-7b3eed3d920e" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.150:59736 10.132.1.150:443 10.132.0.14:40182 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:16:52.303700Z info ads ADS: new connection for node:4 2026-11-03T15:16:52.312615Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T15:16:52.312795Z info cache read certificate from file resource=file-root:system 2026-11-03T15:16:56.782232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:16:58.046916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:17:59.995100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T15:17:59.995895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:59.995924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:59.995966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:17:59.995971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:59.996135Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T15:17:59.866Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 129 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "4b3535ed-23b2-4fe5-b3a2-fe7fe7b2fb17" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.150:42060 10.132.1.150:443 10.132.0.14:39336 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:18:18.645297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T15:18:18.645950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:18:18.645973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:18:18.645984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:18:18.645988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T15:18:18.646151Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T15:18:18.523Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 122 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "39dbe92c-5737-4679-8e63-0e450ff98a37" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.150:38998 10.132.1.150:443 10.132.0.14:55868 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:18:52.679074Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T15:18:52.735657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:18:57.092885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:19:05.685814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:19:05.780319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:19:05.780372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:19:05.780401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T15:19:05.780408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T15:19:05.602Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 177 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "be54237f-3e3c-4fbc-96b6-87b463fd2719" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.150:47910 10.132.1.150:443 10.132.0.14:39414 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:19:21.542092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:19:26.303998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:19:29.510Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 64 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "ee2a1308-bfe9-48c7-90d4-2c8efd32d72f" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55502 10.132.1.150:443 10.132.0.14:44032 - v1-completions-path 2026-11-03T15:19:46.265605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:20:03.312813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:20:11.089Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "3cf221f3-cab3-4397-9378-f86e10a9a9b1" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55502 10.132.1.150:443 10.132.0.14:45944 - v1-completions-path [2026-11-03T15:20:12.945Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 59 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "e686101c-2e20-4026-adae-7e60325dec6c" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55502 10.132.1.150:443 10.132.0.14:45958 - v1-completions-path [2026-11-03T15:20:13.208Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "41c3c384-6015-45ec-8f48-ddbb4dbeb439" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55500 10.132.1.150:443 10.132.0.14:45964 - v1-completions-path 2026-11-03T15:20:34.456182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:20:45.296189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:20:51.935157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:05.352695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:21:05.352733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:21:05.352748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:21:05.352752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T15:21:05.235Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 117 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b7ab20d0-8135-42a1-8b71-7cb1d2bf1353" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.150:35276 10.132.1.150:443 10.132.0.14:35826 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T15:21:07.118Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "be2c45db-d611-4e64-b338-babb5f70ed96" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55500 10.132.1.150:443 10.132.0.14:35830 - v1-completions-path 2026-11-03T15:21:23.215442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:28.105421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:41.796444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:50.873160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:58.953150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:22:08.129329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:22:16.235520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:22:36.938455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:23:08.615639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:23:31.909838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:23:42.584317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:28:14.548390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:28:14.548424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:28:14.548438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:28:14.548443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T15:28:14.437Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 110 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "73a380d7-628a-44d1-9b7d-4260e4d9c355" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.150:41958 10.132.1.150:443 10.132.0.14:49064 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:28:35.654714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:28:52.953096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:28:59.410255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:29:14.188156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:29:29.588680Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:29:34.737699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:29:38.357Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "255519c5-dd92-41f7-9be6-b2130004cc6b" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55500 10.132.1.150:443 10.132.0.14:41216 - v1-completions-path 2026-11-03T15:29:54.688411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:05.445534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:11.811961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:30:26.088Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "53866f5f-e33a-4e94-b076-89e2b34dd5cb" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55500 10.132.1.150:443 10.132.0.14:47130 - v1-completions-path [2026-11-03T15:30:27.537Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 54 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a5e49077-5a3e-44ec-8447-1b5960431d05" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.150:443 10.132.0.14:47140 - v1-completions-path 2026-11-03T15:30:42.046548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:48.482773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:54.633684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:59.648363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:30:59.648410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:30:59.648431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:30:59.648437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T15:30:59.534Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 114 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0cd244b7-e962-4835-9b54-001ddf80278e" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.199:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.150:42644 10.132.1.150:443 10.132.0.14:33912 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T15:31:01.817Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "ac4efa22-9fbc-4656-87ac-ba508db10530" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55502 10.132.1.150:443 10.132.0.14:33916 - v1-completions-path [2026-11-03T15:31:02.801Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "1f3a0fd8-387e-45d6-97a9-30fb338423b6" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55500 10.132.1.150:443 10.132.0.14:33930 - v1-completions-path [2026-11-03T15:31:08.651Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "7f3bcc16-8993-49d5-8f2b-590a65507225" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55500 10.132.1.150:443 10.132.0.14:59598 - v1-completions-path 2026-11-03T15:31:10.071113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:31:10.071149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:31:10.071165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:31:10.071170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T15:31:09.962Z] "DELETE /v1/api-keys/89634291-48ad-4bdb-8c10-c9d30ced5cb1 HTTP/1.1" 200 - via_upstream - "-" 0 365 108 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "99bafd55-aff1-46f4-8a5e-67547f6f3ead" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.199:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.150:42644 10.132.1.150:443 10.132.0.14:59604 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:31:23.645039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:31:34.391137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:31:39.503574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:31:45.994357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:31:50.157Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 75 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "d4eea8af-d3f0-4fe6-a14a-e6e92afc3d77" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.150:55502 10.132.1.150:443 10.132.0.14:49238 - v1-completions-path 2026-11-03T15:31:54.299989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:17.421682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:28.385049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:33.405697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:51.643437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:58.105838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:33:19.557957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:33:39.443661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:33:50.469602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:01.365670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:12.161563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:23.328915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:34.035200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:46.142699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:56.079958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:35:06.502780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:35:17.185363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:35:28.376Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 42 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "d0dbcc4a-c3ab-45e6-a694-c750394c581a" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.150:443 10.132.0.14:52748 - v1-completions-path