2026-10-31T01:20:44.869231Z info FLAG: --concurrency="0" 2026-10-31T01:20:44.869253Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T01:20:44.869257Z info FLAG: --help="false" 2026-10-31T01:20:44.869260Z info FLAG: --log_as_json="false" 2026-10-31T01:20:44.869262Z info FLAG: --log_caller="" 2026-10-31T01:20:44.869264Z info FLAG: --log_output_level="default:info" 2026-10-31T01:20:44.869266Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T01:20:44.869273Z info FLAG: --log_target="[stdout]" 2026-10-31T01:20:44.869275Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T01:20:44.869277Z info FLAG: --outlierLogPath="" 2026-10-31T01:20:44.869280Z info FLAG: --profiling="true" 2026-10-31T01:20:44.869282Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T01:20:44.869284Z info FLAG: --proxyLogLevel="warning" 2026-10-31T01:20:44.869286Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T01:20:44.869288Z info FLAG: --stsPort="0" 2026-10-31T01:20:44.869290Z info FLAG: --templateFile="" 2026-10-31T01:20:44.869292Z info FLAG: --tokenManagerPlugin="" 2026-10-31T01:20:44.869295Z info FLAG: --vklog="0" 2026-10-31T01:20:44.869297Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T01:20:44.869461Z info Proxy role ips=[10.134.0.47] type=router id=maas-default-gateway-openshift-default-75fd9f5d47-9mzcr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T01:20:44.869513Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T01:20:44.870828Z info cpu limit detected as 2, setting concurrency 2026-10-31T01:20:44.871105Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T01:20:44.871116Z info JWT policy is third-party-jwt 2026-10-31T01:20:44.871119Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T01:20:44.874300Z info Starting default Istio SDS Server 2026-10-31T01:20:44.874329Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T01:20:44.874353Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T01:20:44.874469Z info Opening status port 15020 2026-10-31T01:20:44.875193Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T01:20:44.875393Z info sds Starting SDS grpc server 2026-10-31T01:20:44.875412Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T01:20:44.876742Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T01:20:44.877567Z info Starting proxy agent 2026-10-31T01:20:44.877612Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T01:20:44.942644Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T01:20:45.056935Z info cache generated new workload certificate resourceName=default latency=181.420889ms ttl=23h59m59.943069739s 2026-10-31T01:20:45.056980Z info cache Root cert has changed, start rotating root cert 2026-10-31T01:20:45.057015Z info cache returned workload trust anchor from cache ttl=23h59m59.942985385s 2026-10-31T01:20:45.110817Z info ads ADS: new connection for node:1 2026-10-31T01:20:45.115893Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T01:20:45.115941Z info cache read certificate from file resource=file-root:system 2026-10-31T01:20:45.139048Z info ads ADS: new connection for node:2 2026-10-31T01:20:45.139125Z info cache returned workload certificate from cache ttl=23h59m59.860876766s 2026-10-31T01:20:45.139828Z info ads ADS: new connection for node:3 2026-10-31T01:20:45.139959Z info cache returned workload trust anchor from cache ttl=23h59m59.860043605s 2026-10-31T01:20:45.223506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:20:53.170529Z info Readiness succeeded in 8.303976454s 2026-10-31T01:20:53.170949Z info Envoy proxy is ready 2026-10-31T01:21:17.411228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:21:17.411260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:21:17.411269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:21:17.411273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T01:21:17.411436Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T01:21:17.279Z] "POST /anything/e2e-rt-sw-a05b7e-client HTTP/1.1" 200 - via_upstream - "-" 124 1771 132 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "2c523ac0-fa89-40fb-99aa-75f655edec5c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.47:38882 10.134.0.47:443 10.132.0.11:39784 - llm.external-model-e2e-rt-sw-a05b7e-7b5ba21d062f.0 2026-10-31T01:21:28.218698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:21:28.218732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:21:28.218742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:21:28.218748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T01:21:28.218922Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T01:21:28.150Z] "POST /llm/e2e-rt-sw-a05b7e/anything/e2e-rt-sw-a05b7e-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 68 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9c0c1895-6b81-46a0-9907-3fff774d4076" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-a05b7e.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.11:60552 - llm.external-model-e2e-rt-sw-a05b7e-7b5ba21d062f.2 2026-10-31T01:21:46.195913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:22:22.909541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:22:22.909577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:22:22.909587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T01:22:22.909592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:22:22.909783Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T01:22:22.841Z] "POST /llm/e2e-rt-sw-a05b7e/anything/e2e-rt-sw-a05b7e-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 68 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f5c271f6-94ef-4a90-919e-4c647907dfb4" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-a05b7e.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.11:39278 - llm.external-model-e2e-rt-sw-a05b7e-7b5ba21d062f.2 2026-10-31T01:22:39.467897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:22:39.467926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:22:39.467935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:22:39.467939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T01:22:39.468093Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T01:22:39.315Z] "POST /anything/e2e-rt-sw-a05b7e-client HTTP/1.1" 200 - via_upstream - "-" 124 1768 152 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "bf5041fa-5e1b-43be-a627-a1fbc1a0eae5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.47:49818 10.134.0.47:443 10.132.0.11:50400 - llm.external-model-e2e-rt-sw-a05b7e-7b5ba21d062f.0 2026-10-31T01:22:50.142361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:23:09.271133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T01:23:40.279Z] "POST /llm/e2e-rt-eq-c03646/anything/e2e-rt-eq-c03646-client HTTP/1.1" 503 - - "-" 124 0 80 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "2cbcd6df-bca8-415d-bb8d-9b9d33faf76f" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-c03646.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.11:55206 - llm.external-model-e2e-rt-eq-c03646-91d241945d81.4 2026-10-31T01:24:00.002041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:24:07.012235Z info ads ADS: "" 1 terminated 2026-10-31T01:24:08.019758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:24:21.230853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:25:54.915128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:26:07.374132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:27:44.421537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:31:24.959735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T01:32:25.012Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 89 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "71037f2a-1b1e-4fa5-924e-4a9caba25d0f" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.47:443 10.132.0.11:45048 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:32:34.206856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:32:34.206903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:32:34.206921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:32:34.206928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T01:32:33.824Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 382 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "b45e2806-7de0-4f17-be54-f64a0657d938" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:34924 10.134.0.47:443 10.132.0.11:51864 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T01:32:43.345Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 92 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "e904c2c8-ba3a-406e-8f8f-5dc45aac78c2" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:41916 10.134.0.47:443 10.132.0.11:33148 - v1-completions-path 2026-10-31T01:32:45.093114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:32:49.823109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T01:32:49.827445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:32:49.827478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:32:49.827494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T01:32:49.827499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T01:32:49.689Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 138 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "a19d2519-c137-4d63-b78e-61c42870a0b1" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:34924 10.134.0.47:443 10.132.0.11:59872 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:43:58.139948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:43:58.139987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:43:58.140001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:43:58.140006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T01:43:58.637240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T01:43:58.015Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 124 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "cdfc6fea-97a8-448f-b0c0-bc9501ecb018" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:54096 10.134.0.47:443 10.132.0.11:50338 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T01:43:58.351Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 327 77 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "c2af3b37-dbd3-46a2-bfa3-86e30337b3e0" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:41916 10.134.0.47:443 10.132.0.11:50350 - v1-chat-completions-path [2026-10-31T01:43:58.631Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 324 62 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "0ead9cd8-4119-47ad-b83e-589ac25c4659" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:41916 10.134.0.47:443 10.132.0.11:50356 - v1-chat-completions-path 2026-10-31T01:44:02.105908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:44:02.105958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:44:02.105978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:44:02.105984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T01:44:02.106222Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-31T01:44:02.106288Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T01:44:02.106297Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T01:44:02.106300Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T01:44:02.106303Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T01:44:02.042Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 63 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "e0a66b0e-a8c0-433a-85b7-9399fd0ffea8" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:42168 10.134.0.47:443 10.132.0.11:50368 - v1-chat-completions-path 2026-10-31T01:49:40.146310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:49:40.146356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:49:40.146378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T01:49:40.146384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:49:40.991514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:49:40.991554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:49:40.991574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T01:49:40.991579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:49:40.991814Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-31T01:49:40.991887Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:49:40.991898Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:49:40.991902Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:49:40.991906Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T01:49:39.979Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 167 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "5c0e37a7-7a4c-420f-8054-00441ac5a514" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:58542 10.134.0.47:443 10.132.0.11:49590 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T01:49:40.352Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 329 79 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "a206e679-a1bb-48f0-8152-a05097b31e2a" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:41916 10.134.0.47:443 10.132.0.11:49598 - v1-chat-completions-path [2026-10-31T01:49:40.649Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 331 69 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "cfebf4b5-c490-4060-960a-81739a9a1c1f" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:41916 10.134.0.47:443 10.132.0.11:49608 - v1-chat-completions-path [2026-10-31T01:49:40.923Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 126 129 68 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "a0da269c-095d-4f46-bcde-34149a9293f5" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:41916 10.134.0.47:443 10.132.0.11:49614 - v1-chat-completions-path 2026-10-31T01:50:35.127931Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T01:51:50.681319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:51:50.681361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:51:50.681378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:51:50.681383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T01:51:51.000153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:51:51.000191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:51:51.000207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T01:51:51.000211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T01:51:50.286Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 24 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "88d18aed-b9e7-433f-bb57-b4147c9ac812" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.47:443 10.132.0.11:34792 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T01:51:50.572Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 109 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "3785b496-800a-4ff8-a78a-f889e1feedf3" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:42990 10.134.0.47:443 10.132.0.11:34802 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T01:51:50.890Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 110 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f5af8bbc-0566-4a3b-b157-b87f2d35f007" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:42998 10.134.0.47:443 10.132.0.11:34818 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:51:51.831217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:51:51.831264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:51:51.831283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T01:51:51.831289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:51:51.831539Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-31T01:51:51.831614Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:51:51.831625Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:51:51.831628Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:51:51.831633Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T01:51:51.206Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 363 83 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "d3e6c97b-51fe-4f38-8c29-f3cfb9c98dd9" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:42168 10.134.0.47:443 10.132.0.11:34824 - v1-chat-completions-path [2026-10-31T01:51:51.485Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 2328 61 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "498a3d65-fc24-4e6f-81f2-799f2cfe6507" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:42168 10.134.0.47:443 10.132.0.11:34834 - v1-chat-completions-path [2026-10-31T01:51:51.768Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 63 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "78a1df93-ad9f-4b5d-8e50-2899b84a3a8c" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:41916 10.134.0.47:443 10.132.0.11:34844 - v1-completions-path 2026-10-31T01:52:17.175646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:52:17.175710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:52:17.175728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:52:17.175733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T01:52:17.066Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 109 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "38faa800-3fb5-4a02-a278-90289d713da8" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:42990 10.134.0.47:443 10.132.0.11:52968 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:52:49.787923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:52:49.787958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:52:49.787971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T01:52:49.787976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T01:52:49.776Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 11 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f2323503-eb72-480f-8872-a7fb94e58d89" "maas.apps.d97dc7cca18308b940d3.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:42990 10.134.0.47:443 10.132.0.11:59530 - odh-ai-gateway-infra.maas-api-route.4