2026-11-03T02:49:32.487485Z info FLAG: --concurrency="0" 2026-11-03T02:49:32.487503Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T02:49:32.487514Z info FLAG: --help="false" 2026-11-03T02:49:32.487518Z info FLAG: --log_as_json="false" 2026-11-03T02:49:32.487520Z info FLAG: --log_caller="" 2026-11-03T02:49:32.487522Z info FLAG: --log_output_level="default:info" 2026-11-03T02:49:32.487524Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T02:49:32.487529Z info FLAG: --log_target="[stdout]" 2026-11-03T02:49:32.487531Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T02:49:32.487533Z info FLAG: --outlierLogPath="" 2026-11-03T02:49:32.487536Z info FLAG: --profiling="true" 2026-11-03T02:49:32.487538Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T02:49:32.487540Z info FLAG: --proxyLogLevel="warning" 2026-11-03T02:49:32.487542Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T02:49:32.487545Z info FLAG: --stsPort="0" 2026-11-03T02:49:32.487546Z info FLAG: --templateFile="" 2026-11-03T02:49:32.487548Z info FLAG: --tokenManagerPlugin="" 2026-11-03T02:49:32.487551Z info FLAG: --vklog="0" 2026-11-03T02:49:32.487553Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T02:49:32.487701Z info Proxy role ips=[10.134.0.196] type=router id=maas-default-gateway-openshift-default-59f957fdd7-zj6mx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T02:49:32.487747Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T02:49:32.488792Z info cpu limit detected as 2, setting concurrency 2026-11-03T02:49:32.488990Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T02:49:32.489001Z info JWT policy is third-party-jwt 2026-11-03T02:49:32.489004Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T02:49:32.490897Z info Starting default Istio SDS Server 2026-11-03T02:49:32.490925Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T02:49:32.490949Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T02:49:32.491409Z info Opening status port 15020 2026-11-03T02:49:32.492208Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T02:49:32.492897Z info sds Starting SDS grpc server 2026-11-03T02:49:32.493026Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T02:49:32.493589Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T02:49:32.494499Z info Starting proxy agent 2026-11-03T02:49:32.494530Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T02:49:32.559914Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T02:49:32.575040Z info cache generated new workload certificate resourceName=default latency=81.881161ms ttl=23h59m59.424963895s 2026-11-03T02:49:32.575076Z info cache Root cert has changed, start rotating root cert 2026-11-03T02:49:32.575110Z info cache returned workload trust anchor from cache ttl=23h59m59.424890236s 2026-11-03T02:49:32.710662Z info ads ADS: new connection for node:1 2026-11-03T02:49:32.710751Z info cache returned workload certificate from cache ttl=23h59m59.289252243s 2026-11-03T02:49:32.711612Z info ads ADS: new connection for node:2 2026-11-03T02:49:32.711688Z info cache returned workload trust anchor from cache ttl=23h59m59.28831323s 2026-11-03T02:49:32.797768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:49:41.124867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:49:42.052220Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T02:49:43.134750Z info Readiness succeeded in 10.650304988s 2026-11-03T02:49:43.135214Z info Envoy proxy is ready 2026-11-03T02:49:43.703186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:49:57.614938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:50:06.761091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:50:16.520674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:50:35.840176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:50:39.030942Z info ads ADS: new connection for node:3 2026-11-03T02:50:39.031136Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T02:50:39.031166Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T02:50:42.957858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:51:22.202628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T02:51:25.622Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 326 109 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f278eeeb-240b-4377-9da9-378d4ec085c2" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.198:8000" outbound|54321||e2e-prio-pool-1bfe99e1-inference-pool-ip-c2c28be6.llm.svc.cluster.local 10.134.0.196:56724 10.134.0.196:443 10.132.0.19:44782 - v1-model-routing [2026-11-03T02:51:32.296Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 335 55 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "4dc4dee8-4d8c-4ee3-ad74-ec317d167c51" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.198:8000" outbound|54321||e2e-prio-pool-1bfe99e1-inference-pool-ip-c2c28be6.llm.svc.cluster.local 10.134.0.196:56724 10.134.0.196:443 10.132.0.19:57682 - v1-model-routing 2026-11-03T02:51:46.482860Z info ads ADS: "" 3 terminated 2026-11-03T02:51:46.788968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:51:53.484626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:52:08.652353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:54:43.398739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:55:10.308608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:55:32.797642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:55:48.143612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:55:56.813353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:56:10.384643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:56:15.273923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T02:56:18.790Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 79 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "9fa3074b-ea45-421d-971a-1763cd95b89c" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:49734 10.134.0.196:443 10.132.0.19:46046 - v1-completions-path 2026-11-03T02:56:33.862889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:57:22.797988Z info ads ADS: new connection for node:4 2026-11-03T02:57:22.803493Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T02:57:22.803543Z info cache read certificate from file resource=file-root:system 2026-11-03T02:57:26.513538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:57:27.831730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:57:40.285781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:40.285815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:40.285824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T02:57:40.285828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:40.285989Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T02:57:40.086Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 199 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f3db13dc-6529-4e11-a814-6455be7b2754" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.196:49468 10.134.0.196:443 10.132.0.19:56622 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:57:42.630482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:42.630522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:42.630535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:42.630541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T02:57:42.630772Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T02:57:42.507Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 123 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "a8791ced-80fc-4d57-bd67-4b89903bc45b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.196:49468 10.134.0.196:443 10.132.0.19:38862 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:58:04.068685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:04.068721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:04.068732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:04.068739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T02:58:04.068924Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T02:58:03.859Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 209 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "504e1743-86b4-46d7-bd7f-b1eeceadd6d3" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.196:42516 10.134.0.196:443 10.132.0.19:38844 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:58:30.011626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-03T02:58:30.080332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:30.080382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:30.080395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:30.080399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T02:58:30.080574Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T02:58:29.953Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 127 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "92b8b480-68c2-42ab-82a3-4bd78c425c71" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.196:42516 10.134.0.196:443 10.132.0.19:59338 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:58:37.208688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:37.208719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:37.208729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:58:37.208734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T02:58:37.208898Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T02:58:37.081Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 127 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "6eeaef45-64df-4c6c-b318-5947e73cc9bf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.196:42516 10.134.0.196:443 10.132.0.19:52550 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:59:02.564631Z info ads ADS: "" 4 terminated 2026-11-03T02:59:02.608335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:05.279114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:15.944536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:18.450052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T02:59:18.767022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:59:18.767064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:59:18.767087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:59:18.767094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T02:59:18.433Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 333 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "cdeb9942-f2d0-4e37-aa8c-746438a178aa" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.196:46396 10.134.0.196:443 10.132.0.19:57868 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T02:59:34.533354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:39.301570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:58.658619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:00:16.125055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:00:22.411146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:00:22.411191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:00:22.411212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:00:22.411218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T03:00:22.295Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 116 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "5d090c66-df87-432f-b7c6-5e5e675413eb" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.196:56796 10.134.0.196:443 10.132.0.19:34782 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T03:00:27.970Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "7d457150-7325-4924-b768-37ea6d8b7ade" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:40110 10.134.0.196:443 10.132.0.19:34806 - v1-completions-path [2026-11-03T03:00:28.741Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "c5161b41-7800-42e1-99dd-5a67c4e8d732" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:40110 10.134.0.196:443 10.132.0.19:34810 - v1-completions-path [2026-11-03T03:00:29.558Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 57 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "28a83965-4ac5-41d3-8198-90905648cfc6" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:40110 10.134.0.196:443 10.132.0.19:34824 - v1-completions-path 2026-11-03T03:00:46.795713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:00:57.457227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:03.863452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:01:16.689Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "fa6a6a9a-b181-433d-ae96-29101622c69c" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:40110 10.134.0.196:443 10.132.0.19:52192 - v1-completions-path [2026-11-03T03:01:18.815Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "a2aad790-ef8f-4b6e-9356-8699a1abe1b5" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:40110 10.134.0.196:443 10.132.0.19:52208 - v1-completions-path [2026-11-03T03:01:19.068Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "caec9cf1-7db0-4a7a-bd8f-1b55ba3501c1" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:49734 10.134.0.196:443 10.132.0.19:52214 - v1-completions-path 2026-11-03T03:01:32.873579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:37.429652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:49.204306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:58.023199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:02:07.570992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:02:16.464693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:02:24.416400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:02:43.260034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:03:14.954789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:03:38.253824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:03:48.927715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:08:15.943188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:08:33.380703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:08:37.861406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:08:50.959763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:08.599433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:16.479592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:09:20.875Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "36fb856f-d85c-49a7-baa7-7facd43aabb6" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:49734 10.134.0.196:443 10.132.0.19:58548 - v1-completions-path [2026-11-03T03:09:21.611Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "e9bf6b8d-719d-43fc-9e69-df690b90de77" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:40110 10.134.0.196:443 10.132.0.19:58566 - v1-completions-path [2026-11-03T03:09:22.579Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "2750debe-3015-42ff-afe8-6bb2dc701d4d" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:40110 10.134.0.196:443 10.132.0.19:58568 - v1-completions-path 2026-11-03T03:09:36.979829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:47.733100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:54.006701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:10:05.242919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:10:05.242957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:10:05.242972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:10:05.242978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T03:10:05.129Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 113 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "768a60ab-9dd8-4161-bceb-3ca298f56e2a" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.211:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.196:43934 10.134.0.196:443 10.132.0.19:57286 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T03:10:06.712Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "1df6b10a-923d-4129-bfe8-95ac95871477" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:40110 10.134.0.196:443 10.132.0.19:57306 - v1-completions-path 2026-11-03T03:10:22.020343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:10:28.300325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:10:34.309442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:10:41.787519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:10:41.787558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:10:41.787574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:10:41.787579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T03:10:41.674Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 311 112 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "19903fe8-85ea-4511-bfab-73a0cc7cd7a0" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.133.1.160:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.196:53400 10.134.0.196:443 10.132.0.19:52556 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T03:10:50.329Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "5e72e61b-b86d-40fc-9965-59b16f89bba9" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:49734 10.134.0.196:443 10.132.0.19:52594 - v1-completions-path 2026-11-03T03:11:05.278019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:11:15.932956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:11:22.527055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:11:28.520483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:11:39.255584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:11:46.687Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 68 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "3460b331-dfe2-44f1-a215-0228deb82f8f" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.196:49734 10.134.0.196:443 10.132.0.19:41610 - v1-completions-path 2026-11-03T03:12:02.885963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:12:13.713542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:12:18.648163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:12:37.033723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:12:44.095986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:13:04.777821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:13:26.726075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:13:46.760498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:13:57.698979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:08.368511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:19.156986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:30.108873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:40.910639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:51.637930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:15:02.363872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:15:18.441Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 39 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "177f0131-188d-4021-a5d0-2218a0dbb5eb" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.196:443 10.132.0.19:37624 - v1-completions-path