2026-11-03T19:37:11.256591Z info FLAG: --concurrency="0" 2026-11-03T19:37:11.256614Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T19:37:11.256618Z info FLAG: --help="false" 2026-11-03T19:37:11.256620Z info FLAG: --log_as_json="false" 2026-11-03T19:37:11.256622Z info FLAG: --log_caller="" 2026-11-03T19:37:11.256624Z info FLAG: --log_output_level="default:info" 2026-11-03T19:37:11.256626Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T19:37:11.256631Z info FLAG: --log_target="[stdout]" 2026-11-03T19:37:11.256633Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T19:37:11.256635Z info FLAG: --outlierLogPath="" 2026-11-03T19:37:11.256637Z info FLAG: --profiling="true" 2026-11-03T19:37:11.256639Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T19:37:11.256641Z info FLAG: --proxyLogLevel="warning" 2026-11-03T19:37:11.256643Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T19:37:11.256645Z info FLAG: --stsPort="0" 2026-11-03T19:37:11.256647Z info FLAG: --templateFile="" 2026-11-03T19:37:11.256649Z info FLAG: --tokenManagerPlugin="" 2026-11-03T19:37:11.256651Z info FLAG: --vklog="0" 2026-11-03T19:37:11.256654Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T19:37:11.256795Z info Proxy role ips=[10.133.0.29] type=router id=maas-default-gateway-openshift-default-66db998887-t9ft8.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T19:37:11.256903Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T19:37:11.258014Z info cpu limit detected as 2, setting concurrency 2026-11-03T19:37:11.258208Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T19:37:11.258219Z info JWT policy is third-party-jwt 2026-11-03T19:37:11.258222Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T19:37:11.259562Z info Starting default Istio SDS Server 2026-11-03T19:37:11.259585Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T19:37:11.259609Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T19:37:11.259974Z info Opening status port 15020 2026-11-03T19:37:11.260914Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T19:37:11.261677Z info sds Starting SDS grpc server 2026-11-03T19:37:11.261710Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T19:37:11.262483Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T19:37:11.263412Z info Starting proxy agent 2026-11-03T19:37:11.263442Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T19:37:11.298572Z info cache generated new workload certificate resourceName=default latency=36.762719ms ttl=23h59m59.701432391s 2026-11-03T19:37:11.298617Z info cache Root cert has changed, start rotating root cert 2026-11-03T19:37:11.298656Z info cache returned workload trust anchor from cache ttl=23h59m59.701344885s 2026-11-03T19:37:11.326642Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T19:37:11.424355Z info ads ADS: new connection for node:1 2026-11-03T19:37:11.424443Z info cache returned workload certificate from cache ttl=23h59m59.575559135s 2026-11-03T19:37:11.424809Z info ads ADS: new connection for node:2 2026-11-03T19:37:11.424902Z info cache returned workload trust anchor from cache ttl=23h59m59.575098955s 2026-11-03T19:37:11.508666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:37:19.299370Z info Readiness succeeded in 8.045643908s 2026-11-03T19:37:19.299805Z info Envoy proxy is ready 2026-11-03T19:37:37.472935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:37:37.472969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:37:37.472983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:37:37.472988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T19:37:37.317Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 155 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "989c92ff-6b72-459a-8a88-7cec450f25cb" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:48978 10.133.0.29:443 10.132.0.12:37600 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:37:38.359Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 59 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "739b8e52-6e6e-4e27-889b-7aec4665e11d" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.12:37618 - v1-model-routing 2026-11-03T19:39:52.289108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:39:52.289153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:39:52.289175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T19:39:52.289180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T19:39:52.171Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 117 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "9f3519d6-ea7c-4b70-8d55-5f062cb62649" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:56428 10.133.0.29:443 10.132.0.12:56160 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:40:02.533010Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T19:40:02.533034Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T19:40:02.533037Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T19:40:02.533041Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T19:40:02.484Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 49 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "d0b8791e-3a7c-42cf-87de-91e1ff9b9ecc" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.12:37290 - v1-completions-path 2026-11-03T19:40:13.005804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:40:29.080721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:43:10.438595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:43:10.438743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:43:10.438805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T19:43:10.438861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T19:43:10.221Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 217 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "20649262-38e8-48f9-b9e2-f0f443512942" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:60382 10.133.0.29:443 10.132.0.12:59128 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:43:11.068Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 340 141 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "acdae579-38b0-454e-9f5b-c5a9528c5809" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:55862 10.133.0.29:443 10.132.0.12:59144 - v1-chat-completions-path 2026-11-03T19:44:12.093797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:44:49.713088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:45:56.233105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:46:25.060949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:46:59.030717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:48:17.117944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:50:52.606658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:38.594109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:53:59.562229Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:54:21.313460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:08.853101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T19:55:15.421Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "9bfd0528-f844-488c-b6b7-e0f9c4ac0f92" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:44080 10.133.0.29:443 10.132.0.12:41544 - v1-completions-path 2026-11-03T19:55:27.284226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:29.005455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:46.212143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:48.153237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:50.839458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:59.144116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T19:56:05.543Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "235508f8-7557-4525-8c8f-8d52c3fc0408" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:44080 10.133.0.29:443 10.132.0.12:51902 - v1-completions-path [2026-11-03T19:56:07.279Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "d9985d93-fee1-4d29-8b73-1f21ddb8c2d1" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:39728 10.133.0.29:443 10.132.0.12:51910 - v1-completions-path 2026-11-03T19:56:08.107643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T19:56:08.102Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 78 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "0f226be7-8881-46bf-b2f6-6f2881526283" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:44080 10.133.0.29:443 10.132.0.12:40092 - v1-completions-path 2026-11-03T19:56:24.067279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:56:34.206112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:56:36.017750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T19:56:43.142Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 70 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "108ee0a0-68e0-4ac2-b8de-a076bcd8ffec" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:39728 10.133.0.29:443 10.132.0.12:55658 - v1-completions-path 2026-11-03T19:56:55.321878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:56:56.987218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:13.246140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:15.004094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:31.850800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:33.627238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:49.654906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:00.279998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:02.921075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:24.922268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T19:58:24.922340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:58:24.922367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:58:24.922388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T19:58:24.922395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T19:58:24.860Z] "DELETE /v1/api-keys/bb36549d-742f-4f12-a20a-df477f70ebdb HTTP/1.1" 200 - via_upstream - "-" 0 375 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "80b50f33-bc45-402b-b3f5-0e060a61a004" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:51044 10.133.0.29:443 10.132.0.12:47104 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:58:28.788614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:35.191103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:58:35.191144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:58:35.191162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:58:35.191168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:58:35.128Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "805069e8-84f2-4589-a164-6fd305c76bc0" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:51044 10.133.0.29:443 10.132.0.12:43530 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:58:47.109350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:57.295437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T19:59:12.348Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "7f4e5eee-b66d-45c4-bbf3-f804dce4b4f8" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.12:36220 - v1-completions-path 2026-11-03T20:02:15.942929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:02:31.423570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:02:33.339383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:02:50.554013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:14.376951Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:04:14.376983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:04:14.376994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:04:14.376999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:04:14.322Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 54 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "d172ff39-4251-4b80-a4f7-646ded1b3d43" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:48134 10.133.0.29:443 10.132.0.12:49762 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:04:19.385124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:34.878927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:50.767594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:02.401592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:06.611291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:14.784620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:17.478965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:22.998023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:05:22.998058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:05:22.998072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:05:22.998077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:05:23.110666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:05:23.110705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:05:23.110721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:05:23.110725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:05:22.933Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 65 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c4975d43-7d02-4ad2-9e2c-b90416bffef9" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:48354 10.133.0.29:443 10.132.0.12:39806 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:05:23.058Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 52 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "829cfd5c-7677-42d3-8344-c7531869c69d" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:48358 10.133.0.29:443 10.132.0.12:39810 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:05:35.287150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:51.983440Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T20:08:18.817307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:24.691136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:08:24.691171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:08:24.691186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:08:24.691191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:08:24.624Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 67 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "71a0efc2-b9c6-4469-b39a-17711bd679e5" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.150:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:56276 10.133.0.29:443 10.132.0.12:55596 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:08:27.318723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:30.779008Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T20:08:30.703Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 75 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "af5fe20b-c908-49b1-a03d-15371c0da7a7" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:40332 10.133.0.29:443 10.132.0.12:34600 - v1-catch-all-path [2026-11-03T20:08:31.170Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "ea353257-494d-4258-b607-0ea731ef6587" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.12:34608 - v1-catch-all-path 2026-11-03T20:08:42.775123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:44.419385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:59.165099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:10.056994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8