2026-10-31T12:36:34.021736Z info FLAG: --concurrency="0" 2026-10-31T12:36:34.021755Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T12:36:34.021760Z info FLAG: --help="false" 2026-10-31T12:36:34.021762Z info FLAG: --log_as_json="false" 2026-10-31T12:36:34.021764Z info FLAG: --log_caller="" 2026-10-31T12:36:34.021766Z info FLAG: --log_output_level="default:info" 2026-10-31T12:36:34.021768Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T12:36:34.021817Z info FLAG: --log_target="[stdout]" 2026-10-31T12:36:34.021820Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T12:36:34.021822Z info FLAG: --outlierLogPath="" 2026-10-31T12:36:34.021824Z info FLAG: --profiling="true" 2026-10-31T12:36:34.021826Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T12:36:34.021828Z info FLAG: --proxyLogLevel="warning" 2026-10-31T12:36:34.021829Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T12:36:34.021831Z info FLAG: --stsPort="0" 2026-10-31T12:36:34.021833Z info FLAG: --templateFile="" 2026-10-31T12:36:34.021835Z info FLAG: --tokenManagerPlugin="" 2026-10-31T12:36:34.021838Z info FLAG: --vklog="0" 2026-10-31T12:36:34.021840Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T12:36:34.021988Z info Proxy role ips=[10.133.0.31] type=router id=maas-default-gateway-openshift-default-645cf464d7-lsjpx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T12:36:34.022031Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T12:36:34.023090Z info cpu limit detected as 2, setting concurrency 2026-10-31T12:36:34.023291Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T12:36:34.023302Z info JWT policy is third-party-jwt 2026-10-31T12:36:34.023305Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T12:36:34.025279Z info Starting default Istio SDS Server 2026-10-31T12:36:34.025304Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T12:36:34.025327Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T12:36:34.025603Z info Opening status port 15020 2026-10-31T12:36:34.026627Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T12:36:34.027930Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T12:36:34.028755Z info Starting proxy agent 2026-10-31T12:36:34.028793Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T12:36:34.037883Z info sds Starting SDS grpc server 2026-10-31T12:36:34.037904Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T12:36:34.093910Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T12:36:34.228459Z info cache generated new workload certificate resourceName=default latency=201.572746ms ttl=23h59m59.771545105s 2026-10-31T12:36:34.228493Z info cache Root cert has changed, start rotating root cert 2026-10-31T12:36:34.228525Z info cache returned workload trust anchor from cache ttl=23h59m59.771475393s 2026-10-31T12:36:34.273991Z info ads ADS: new connection for node:1 2026-10-31T12:36:34.274310Z info cache returned workload certificate from cache ttl=23h59m59.725692632s 2026-10-31T12:36:34.274330Z info ads ADS: new connection for node:2 2026-10-31T12:36:34.274554Z info cache returned workload trust anchor from cache ttl=23h59m59.725447433s 2026-10-31T12:36:34.353928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:36:42.201220Z info Readiness succeeded in 8.181860892s 2026-10-31T12:36:42.201686Z info Envoy proxy is ready [2026-10-31T12:37:06.991Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 64 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "4df2576c-614a-41b7-8a5c-96f11b3946a1" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.31:443 10.132.0.9:52162 - v1-model-routing 2026-10-31T12:37:08.074793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:37:08.074832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:37:08.074845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:37:08.074850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:37:07.369Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "e6369001-4339-48d1-8601-b42b5a530e61" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.31:443 10.132.0.9:52170 - v1-model-routing [2026-10-31T12:37:08.056Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 18 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "2461cde8-fca4-419c-a44f-cae1b7d86e0e" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:43128 10.133.0.31:443 10.132.0.9:52172 - odh-ai-gateway-infra.maas-api-route.4 2026-10-31T12:39:27.651090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:27.651126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:27.651140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:39:27.651145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:28.160286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:28.160321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:28.160335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:39:28.160340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T12:39:27.471Z] "DELETE /v1/api-keys/815e48d5-e651-437d-b990-15f6ea9fdac5 HTTP/1.1" 200 - via_upstream - "-" 0 321 179 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2fca438a-7c97-4beb-bcc7-3e77c9c534be" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:43370 10.133.0.31:443 10.132.0.9:44770 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:39:28.012Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 147 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "62636683-c169-416c-bb5d-abf38db3f2b1" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:43384 10.133.0.31:443 10.132.0.9:44774 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:39:29.941Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 100 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4cd337e7-58ad-41e8-ae9e-0aed17a248ea" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:52546 10.133.0.31:443 10.132.0.9:44790 - v1-completions-path [2026-10-31T12:39:30.098Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 67 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2373bd2e-ba22-4ae8-8be3-f383e55ec3e5" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:52552 10.133.0.31:443 10.132.0.9:44794 - v1-completions-path [2026-10-31T12:39:30.372Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 8 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "0934a97f-eb8b-4edd-9a3b-fb7a9ba31a84" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.31:443 10.132.0.9:44802 - - 2026-10-31T12:39:51.625436Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:40:09.198511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:44:20.708246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:45:08.798611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:45:49.255744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:46:27.663597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:48:36.546902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:50:33.244594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:51:19.049066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:01:13.357874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:01:36.183193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:02:22.089314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:02:28.502Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 75 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "950dd225-cbba-48aa-be45-15b91250ace2" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:39554 10.133.0.31:443 10.132.0.9:39548 - v1-completions-path 2026-10-31T13:02:40.280368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:02:42.338201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:02:59.097944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:03:00.814597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:03:03.517504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:03:12.119030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:03:17.658262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:03:17.658301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:03:17.658322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:03:17.658327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T13:03:17.593Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 320 64 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "b1d29c49-7b0c-4822-8022-325253f3dd83" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:46688 10.133.0.31:443 10.132.0.9:38680 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:03:20.219Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "536e38a9-563b-4766-861a-ca595e1d5acf" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:39554 10.133.0.31:443 10.132.0.9:38706 - v1-completions-path [2026-10-31T13:03:20.570Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1ce5108b-6d4f-47c3-ac14-24f0e2706e88" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:48436 10.133.0.31:443 10.132.0.9:38716 - v1-completions-path 2026-10-31T13:03:36.029523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:03:46.408454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:03:48.200241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:03:53.452Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 305 58 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2daec696-1d35-4902-9668-bcf12931d96c" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:39554 10.133.0.31:443 10.132.0.9:47242 - v1-completions-path 2026-10-31T13:03:54.546681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-31T13:03:54.375Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "67fde78f-b6b7-4f81-948c-01a363e78417" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:48436 10.133.0.31:443 10.132.0.9:34198 - v1-completions-path [2026-10-31T13:03:54.489Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "fcc1ef03-3cb7-41d5-be06-5dc2745e5b8a" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:48436 10.133.0.31:443 10.132.0.9:34214 - v1-completions-path 2026-10-31T13:04:06.804480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:04:08.450163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:04:24.931664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:04:27.049523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:04:43.674007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:04:45.334411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:05:01.440972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:05:12.124770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:05:14.767032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:05:26.193562Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T13:05:33.688329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:05:35.721329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:05:39.571583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-31T13:05:39.579664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:05:39.579698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:05:39.579713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:05:39.579718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T13:05:39.515Z] "DELETE /v1/api-keys/a5163052-3eff-420f-8a3a-94e809c6d2ef HTTP/1.1" 200 - via_upstream - "-" 0 375 64 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4dc976aa-5c51-4f92-bb0b-7c872b6bb055" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:44608 10.133.0.31:443 10.132.0.9:42810 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:05:40.805Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 32 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "52a87c24-cd2a-4cd4-8a7a-1057f71fd1d9" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.31:443 10.132.0.9:42812 - v1-completions-path 2026-10-31T13:05:43.199643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:05:49.468825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:05:49.468863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:05:49.468878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:05:49.468883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T13:05:49.402Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 66 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1b4cf63b-bd95-4228-8eef-fa297fe468ab" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:44608 10.133.0.31:443 10.132.0.9:47076 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:06:01.297306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:06:11.601193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:06:26.826740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:06:29.511419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:08:05.901505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:08:08.930541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:09:36.330811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:09:38.814Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 285 466 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "94b6c80e-533c-4f9a-9d18-9b7cc308b46b" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:48994 10.133.0.31:443 10.132.0.9:52320 - v1-completions-path 2026-10-31T13:09:51.489917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:09:53.157919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:10:10.329602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:11:32.582532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:11:32.582566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:11:32.582580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:11:32.582584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T13:11:32.518Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ccabac4c-2afb-41da-a683-fae9cf1007a4" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:35724 10.133.0.31:443 10.132.0.9:43346 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:11:36.715454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:11:52.402899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:12:07.163851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:12:07.163888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:12:07.163903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:12:07.163908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T13:12:07.092Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 71 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4fc6f51b-51e6-41e4-a1d2-b153732249db" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:35724 10.133.0.31:443 10.132.0.9:60886 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:12:08.607881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:12:20.261281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:12:23.663954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:12:23.663994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:12:23.664009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:12:23.664014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T13:12:23.180Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 483 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "64907b3c-c385-4876-8af8-748287cb2e24" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:34104 10.133.0.31:443 10.132.0.9:39490 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:12:24.348507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:12:35.401335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:12:37.339047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:12:44.416892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:12:44.416929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:12:44.416945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:12:44.416950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T13:12:44.354Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a20d4bd9-5eae-4fe6-b374-1ee8139d7b76" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.31:35724 10.133.0.31:443 10.132.0.9:37718 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:12:56.542651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:15:47.522452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:15:50.918546Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T13:15:50.837Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 81 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "40a110b7-cc99-487f-bfa6-fba7cf7d333c" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.31:45168 10.133.0.31:443 10.132.0.9:40040 - v1-catch-all-path 2026-10-31T13:15:52.889384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:16:10.853178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:16:12.728886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:16:27.122779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:16:37.946718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8