2026-10-30T21:47:44.964435Z info FLAG: --concurrency="0" 2026-10-30T21:47:44.964453Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T21:47:44.964457Z info FLAG: --help="false" 2026-10-30T21:47:44.964460Z info FLAG: --log_as_json="false" 2026-10-30T21:47:44.964462Z info FLAG: --log_caller="" 2026-10-30T21:47:44.964464Z info FLAG: --log_output_level="default:info" 2026-10-30T21:47:44.964466Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T21:47:44.964470Z info FLAG: --log_target="[stdout]" 2026-10-30T21:47:44.964472Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T21:47:44.964474Z info FLAG: --outlierLogPath="" 2026-10-30T21:47:44.964476Z info FLAG: --profiling="true" 2026-10-30T21:47:44.964478Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T21:47:44.964480Z info FLAG: --proxyLogLevel="warning" 2026-10-30T21:47:44.964483Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T21:47:44.964485Z info FLAG: --stsPort="0" 2026-10-30T21:47:44.964487Z info FLAG: --templateFile="" 2026-10-30T21:47:44.964489Z info FLAG: --tokenManagerPlugin="" 2026-10-30T21:47:44.964492Z info FLAG: --vklog="0" 2026-10-30T21:47:44.964494Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T21:47:44.964643Z info Proxy role ips=[10.133.0.54] type=router id=maas-default-gateway-openshift-default-7df854bf67-vjrqn.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T21:47:44.964687Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T21:47:44.965830Z info cpu limit detected as 2, setting concurrency 2026-10-30T21:47:44.966425Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T21:47:44.966437Z info JWT policy is third-party-jwt 2026-10-30T21:47:44.966440Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T21:47:44.967793Z info Starting default Istio SDS Server 2026-10-30T21:47:44.967813Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T21:47:44.967831Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T21:47:44.968222Z info Opening status port 15020 2026-10-30T21:47:44.969412Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T21:47:44.969872Z info sds Starting SDS grpc server 2026-10-30T21:47:44.969950Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T21:47:44.970860Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T21:47:44.971718Z info Starting proxy agent 2026-10-30T21:47:44.971749Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T21:47:45.035770Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T21:47:45.110700Z info cache generated new workload certificate resourceName=default latency=140.644836ms ttl=23h59m59.889307246s 2026-10-30T21:47:45.110751Z info cache Root cert has changed, start rotating root cert 2026-10-30T21:47:45.110795Z info cache returned workload trust anchor from cache ttl=23h59m59.889205915s 2026-10-30T21:47:45.186906Z info ads ADS: new connection for node:1 2026-10-30T21:47:45.186976Z info cache returned workload certificate from cache ttl=23h59m59.813026513s 2026-10-30T21:47:45.187273Z info ads ADS: new connection for node:2 2026-10-30T21:47:45.187347Z info cache returned workload trust anchor from cache ttl=23h59m59.812654527s 2026-10-30T21:47:45.271454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:47:53.474142Z info Readiness succeeded in 8.512431215s 2026-10-30T21:47:53.474602Z info Envoy proxy is ready [2026-10-30T21:48:31.667Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 64 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "bc42757e-81e1-415c-8fd2-36d7fb72b41a" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.54:443 10.133.0.9:56652 - v1-model-routing 2026-10-30T21:48:33.320452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:48:33.320496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:48:33.320516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:48:33.320522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T21:48:33.206Z] "DELETE /v1/api-keys/1131c172-e911-4d85-96bb-cc31ad480db1 HTTP/1.1" 200 - via_upstream - "-" 0 365 114 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "f552d2df-a7a1-46c3-8edc-36840a05141b" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:38358 10.133.0.54:443 10.133.0.9:56674 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:48:34.173744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:48:34.173782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:48:34.173797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:48:34.173802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T21:48:34.069Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 103 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "ddb3fea6-0512-4dac-8cf5-5bd1f970a06c" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:38358 10.133.0.54:443 10.133.0.9:56682 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:54:42.882023Z info ads ADS: new connection for node:3 2026-10-30T21:54:42.887153Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T21:54:42.887343Z info cache read certificate from file resource=file-root:system 2026-10-30T21:54:47.822869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:54:53.688052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:55:11.189160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:55:25.579728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:55:25.579773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:55:25.579790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:55:25.579796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:55:25.580055Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T21:55:25.500Z] "POST /llm/e2e-rt-sw-29f695/anything/e2e-rt-sw-29f695-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 79 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "1ad7af5c-12dd-4b5d-b15a-08025631f3f8" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-29f695.llm.svc.cluster.local - 10.133.0.54:443 10.133.0.9:36274 - llm.external-model-e2e-rt-sw-29f695-6fd0125525f2.2 2026-10-30T21:55:38.921544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:55:43.144294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:55:43.144338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:55:43.144354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:55:43.144360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:55:43.144626Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T21:55:42.856Z] "POST /anything/e2e-rt-sw-29f695-client HTTP/1.1" 200 - via_upstream - "-" 124 1760 288 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "e0a14ec1-de00-4a97-9999-cf12de70a180" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.54:33322 10.133.0.54:443 10.133.0.9:45312 - llm.external-model-e2e-rt-sw-29f695-6fd0125525f2.0 2026-10-30T21:56:40.110768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:58:04.161042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:58:25.307426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T21:58:35.337Z] "POST /llm/e2e-rt-eq-11bc42/anything/e2e-rt-eq-11bc42-client HTTP/1.1" 503 - - "-" 124 0 84 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "45887cbf-8929-431c-b3a2-4872f710f73c" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-11bc42.llm.svc.cluster.local - 10.133.0.54:443 10.133.0.9:57630 - llm.external-model-e2e-rt-eq-11bc42-69d88dfde56e.4 2026-10-30T21:59:23.993799Z info ads ADS: "" 3 terminated 2026-10-30T21:59:27.279052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:59:29.734801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:59:56.499393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:00:29.600411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:00:46.593371Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:23.677622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:09:30.153938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:30.153983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:30.154005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:30.154013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:09:29.998Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 155 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "cd26274d-77a6-431a-9ed5-0599d2889f6c" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:54992 10.133.0.54:443 10.133.0.9:33602 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:09:32.883463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:32.883499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:32.883521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:09:32.883526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:33.195057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:33.195095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:33.195110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:33.195115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:09:32.499Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 83 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "6baa0bba-a006-4210-bbcc-06e1cad0e961" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.54:443 10.133.0.9:33632 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:09:32.768Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 115 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "2cdfda8e-8188-40b1-bfbb-ff66de77a22d" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:55006 10.133.0.54:443 10.133.0.9:33642 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:09:33.067Z] "DELETE /v1/api-keys/6f40a7bd-fc75-4eb0-a3d1-27f0f45281c1 HTTP/1.1" 200 - via_upstream - "-" 0 321 128 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "586c2b51-60cb-417d-bf52-09f3d6242722" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:54992 10.133.0.54:443 10.133.0.9:33650 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:09:41.356095Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:09:41.356121Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:09:41.356125Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:09:41.356129Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T22:09:41.309Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 47 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "418fdbac-f6f8-47b9-a443-4461a2c744de" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.54:443 10.133.0.9:48302 - v1-completions-path 2026-10-30T22:09:45.487961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:45.487999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:45.488017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:09:45.488024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:09:45.802220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:45.802275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:45.802291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:45.802296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:09:45.373Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 114 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "91cfc14d-da4d-41e3-a9cf-965b8d3bda34" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:54992 10.133.0.54:443 10.133.0.9:41746 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:09:45.694Z] "DELETE /v1/api-keys/0cfd362d-7466-40b5-bb0a-d2982b39d440 HTTP/1.1" 200 - via_upstream - "-" 0 321 108 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "9fc435c3-570e-4e7e-bd14-c27865612b51" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:55006 10.133.0.54:443 10.133.0.9:41762 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:09:46.396865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T22:09:46.402343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:46.402382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:46.402399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:46.402404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:09:46.295Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 106 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "d805cf68-a567-4c03-a16b-d70a8dbdfb84" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:55006 10.133.0.54:443 10.133.0.9:41770 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:09:50.359827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T22:09:50.305Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 75 - "34.228.250.194,10.133.0.9" "-" "b545e7cf-d57d-4c67-8361-621ca403969f" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.54:37830 10.133.0.54:443 10.133.0.9:41792 - v1-completions-path 2026-10-30T22:10:01.487298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:10:01.487422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:10:01.487453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:10:01.487460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:10:01.464Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 22 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "a2a87540-3300-4640-9ec3-a188e5973838" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:55006 10.133.0.54:443 10.133.0.9:41626 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T22:10:19.172389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:11:00.933550Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:17:00.166987Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 [2026-10-30T22:17:41.876Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 319 81 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "a8a3e6c9-ed16-402d-8129-576bf622a40a" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.54:41700 10.133.0.54:443 10.133.0.9:60416 - v1-chat-completions-path 2026-10-30T22:24:42.129606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:24:42.129647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:24:42.129670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:24:42.129677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:24:42.114Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 14 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "e6aa43ff-61f7-46b2-baf4-868f2257ed5c" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:57696 10.133.0.54:443 10.133.0.9:54710 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T22:24:42.735753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:24:42.735787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:24:42.735805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:24:42.735809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T22:24:42.622Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 113 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "7f9e4cbc-662f-4d6b-a91f-69c3a0826bfa" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:57712 10.133.0.54:443 10.133.0.9:54724 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:26:13.439Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 31 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "54976bce-bf01-4240-b810-08eea0069d88" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.54:443 10.133.0.9:37316 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:26:18.964148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:26:18.964188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:26:18.964207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:26:18.964212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:26:18.835Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 128 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "7f657b03-b838-47f6-a27c-d51ba88581c8" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:47934 10.133.0.54:443 10.133.0.9:51436 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:26:19.588Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 364 86 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "852ea0a4-0be6-4e8d-8b08-1022687ed184" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.54:37830 10.133.0.54:443 10.133.0.9:51446 - v1-chat-completions-path 2026-10-30T22:28:12.499753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:28:12.499803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:28:12.499830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:28:12.499837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:28:12.384Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 115 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "00c93c74-9b79-443c-9d6c-472eeed9abe4" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "10.134.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.54:35116 10.133.0.54:443 10.133.0.9:34552 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:38:43.332Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 10 - "34.228.250.194,10.133.0.9" "python-requests/2.34.2" "ff0123de-fc67-43a8-a23f-4524c4f6cb79" "maas.apps.0799e4c1534df8151e73.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.54:443 10.133.0.9:53576 - - 2026-10-30T22:45:03.154384Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T22:52:03.029318Z info ads ADS: new connection for node:4 2026-10-30T22:52:03.041332Z info cache read certificate from file resource=file-root:system 2026-10-30T22:53:37.312346Z info ads ADS: "" 4 terminated