2026-11-04T07:32:39.703041Z info FLAG: --concurrency="0" 2026-11-04T07:32:39.703059Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T07:32:39.703064Z info FLAG: --help="false" 2026-11-04T07:32:39.703067Z info FLAG: --log_as_json="false" 2026-11-04T07:32:39.703070Z info FLAG: --log_caller="" 2026-11-04T07:32:39.703073Z info FLAG: --log_output_level="default:info" 2026-11-04T07:32:39.703076Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T07:32:39.703082Z info FLAG: --log_target="[stdout]" 2026-11-04T07:32:39.703086Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T07:32:39.703089Z info FLAG: --outlierLogPath="" 2026-11-04T07:32:39.703093Z info FLAG: --profiling="true" 2026-11-04T07:32:39.703095Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T07:32:39.703099Z info FLAG: --proxyLogLevel="warning" 2026-11-04T07:32:39.703102Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T07:32:39.703104Z info FLAG: --stsPort="0" 2026-11-04T07:32:39.703107Z info FLAG: --templateFile="" 2026-11-04T07:32:39.703110Z info FLAG: --tokenManagerPlugin="" 2026-11-04T07:32:39.703114Z info FLAG: --vklog="0" 2026-11-04T07:32:39.703118Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T07:32:39.703293Z info Proxy role ips=[10.134.0.22] type=router id=maas-default-gateway-openshift-default-74854d8ccf-xgjgh.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T07:32:39.703378Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T07:32:39.704955Z info cpu limit detected as 2, setting concurrency 2026-11-04T07:32:39.705164Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T07:32:39.705185Z info JWT policy is third-party-jwt 2026-11-04T07:32:39.705190Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T07:32:39.706863Z info Starting default Istio SDS Server 2026-11-04T07:32:39.706888Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T07:32:39.706912Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T07:32:39.707430Z info Opening status port 15020 2026-11-04T07:32:39.708300Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T07:32:39.708817Z info sds Starting SDS grpc server 2026-11-04T07:32:39.708852Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T07:32:39.709847Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T07:32:39.710716Z info Starting proxy agent 2026-11-04T07:32:39.710754Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T07:32:39.772592Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T07:32:39.834835Z info cache generated new workload certificate resourceName=default latency=125.85791ms ttl=23h59m59.165179853s 2026-11-04T07:32:39.834869Z info cache Root cert has changed, start rotating root cert 2026-11-04T07:32:39.834897Z info cache returned workload trust anchor from cache ttl=23h59m59.165103013s 2026-11-04T07:32:39.860449Z info ads ADS: new connection for node:1 2026-11-04T07:32:39.860547Z info cache returned workload certificate from cache ttl=23h59m59.139454712s 2026-11-04T07:32:39.860722Z info ads ADS: new connection for node:2 2026-11-04T07:32:39.860789Z info cache returned workload trust anchor from cache ttl=23h59m59.139211709s 2026-11-04T07:32:39.902419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:32:45.637406Z info Readiness succeeded in 5.936899206s 2026-11-04T07:32:45.637828Z info Envoy proxy is ready 2026-11-04T07:33:22.377347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:33:22.933423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:33:52.699664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:33:54.643596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:33:57.803569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:34:00.410941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:34:03.590899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T07:34:26.163Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 344 85 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "53065aeb-42fb-4502-9a50-36935b1fba58" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.22:48770 10.134.0.22:443 10.132.0.9:49770 - v1-model-routing [2026-11-04T07:34:26.569Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 60 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "5293aff5-3958-4967-b657-46009e5dff1c" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.22:443 10.132.0.9:49776 - v1-model-routing [2026-11-04T07:34:26.691Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "2b08707a-5b3b-4bf2-b4fc-d26bc31052b5" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.22:443 10.132.0.9:49778 - v1-model-routing 2026-11-04T07:34:27.243278Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T07:34:27.243306Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T07:34:27.243310Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T07:34:27.243314Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 2026-11-04T07:34:27.367294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:34:27.367330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:34:27.367347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:34:27.367354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T07:34:26.801Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 49 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "61f17043-a3e5-4142-a514-315a7e4cd0dc" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.22:443 10.132.0.9:49790 - v1-model-routing [2026-11-04T07:34:26.968Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "8400b940-6b49-4bc4-bfbc-7a90a246c14f" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.22:443 10.132.0.9:49794 - v1-model-routing [2026-11-04T07:34:27.103Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 57 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "03da867a-c9d2-44b0-aa9c-b1ee1fcd9a4a" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.22:443 10.132.0.9:49804 - v1-model-routing [2026-11-04T07:34:27.226Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 17 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "ec9bd937-78ac-4fcd-95e5-95590379be36" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.22:443 10.132.0.9:49818 - v1-model-routing [2026-11-04T07:34:27.306Z] "DELETE /v1/api-keys/77504c80-5c2d-401a-9dd4-ffdbb6b44ca5 HTTP/1.1" 200 - via_upstream - "-" 0 365 61 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "a110fda1-4bab-429c-a882-a367718b4d0a" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49220 10.134.0.22:443 10.132.0.9:49834 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T07:34:27.777380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:34:27.777412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:34:27.777429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:34:27.777434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T07:34:27.769Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 7 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "21b81614-5d8d-4c6a-af73-8c83c9d526a8" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49220 10.134.0.22:443 10.132.0.9:49842 - odh-ai-gateway-infra.maas-api-route.4 2026-11-04T07:36:38.672292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:38.672324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:38.672335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:38.672340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T07:36:38.220Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 48 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "80649115-10f2-4f75-906a-2c451d89a4c7" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.22:443 10.132.0.9:44904 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T07:36:38.593Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 78 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "de584b4a-0565-4bd7-a1b4-77a5d40c30f6" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49286 10.134.0.22:443 10.132.0.9:44910 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T07:36:39.618Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 37 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ef315cb1-ef23-4549-a7af-f402a5a6a03f" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.22:443 10.132.0.9:44922 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T07:36:40.258793Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T07:36:40.258822Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T07:36:40.258825Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T07:36:40.258829Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 2026-11-04T07:36:40.270458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T07:36:40.325218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:40.325262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:40.325283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T07:36:40.325290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:40.441933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:40.441984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:40.442001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T07:36:40.442007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:40.726697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:40.726729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:40.726740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:40.726746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T07:36:40.211Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 47 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "9470f617-93f4-4fd9-a5f8-57a99cf742d2" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.22:443 10.132.0.9:44928 - v1-completions-path [2026-11-04T07:36:40.265Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "66bd52e1-1331-42fa-afdc-43e7e65a025f" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49286 10.134.0.22:443 10.132.0.9:44936 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T07:36:40.383Z] "DELETE /v1/api-keys/e5e50e49-bc15-4190-bc40-15656c9e3c31 HTTP/1.1" 200 - via_upstream - "-" 0 321 58 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "3f021ee2-4937-4af5-8dcf-d2c570f849b4" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49290 10.134.0.22:443 10.132.0.9:44940 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T07:36:40.669Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 57 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "a7238072-fbe3-4ff9-8e72-86ac2453f21b" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49290 10.134.0.22:443 10.132.0.9:44948 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T07:36:41.779759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:41.779793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:41.779807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:41.779812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T07:36:41.723Z] "DELETE /v1/api-keys/2e6ed9db-84d0-44cc-ba5e-c8a8cf294012 HTTP/1.1" 200 - via_upstream - "-" 0 321 56 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "6b6f51af-a585-4612-897b-97f0fbb8e1d4" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49286 10.134.0.22:443 10.132.0.9:44978 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T07:36:44.612625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-04T07:36:44.671641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:44.671678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:44.671693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:44.671698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T07:36:44.736444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:44.736483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:44.736499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T07:36:44.736506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T07:36:44.606Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "1fdf8abc-7acc-4621-b79d-ac76c9ce4b3a" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49290 10.134.0.22:443 10.132.0.9:41174 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T07:36:44.725Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 11 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "110a0db1-d3b6-41c5-a051-a7d5e645ff6c" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49290 10.134.0.22:443 10.132.0.9:41188 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-04T07:36:44.791Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 21 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "00354025-0a4a-4af2-9a1b-08d1670bddd6" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.22:443 10.132.0.9:41202 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T07:36:45.044097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:45.044134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:45.044148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:45.044153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T07:36:45.761841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:45.761881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:45.761897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T07:36:45.761904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T07:36:44.980Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 328 63 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "0cf4c9a9-f31f-45a7-809f-f7bd59801fd1" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49290 10.134.0.22:443 10.132.0.9:41208 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T07:36:45.234Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 2825 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "dba52e95-3475-48e1-891f-3ed2fda62851" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.22:48770 10.134.0.22:443 10.132.0.9:41220 - v1-chat-completions-path [2026-11-04T07:36:45.701Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "36510226-8792-4651-9d64-a5b184acd834" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49290 10.134.0.22:443 10.132.0.9:41226 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T07:36:45.864515Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T07:36:45.864538Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T07:36:45.864542Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T07:36:45.864546Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-04T07:36:45.818Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 46 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "2b64fbf4-5cb5-4c6f-a01a-5de651faded5" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.22:443 10.132.0.9:41238 - v1-completions-path 2026-11-04T07:36:49.285728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:49.285760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:49.285772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T07:36:49.285776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T07:36:49.229Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 56 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "71018f50-5fee-46d2-b07f-f70ccc61c7c8" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.22:49286 10.134.0.22:443 10.132.0.9:41248 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T07:36:49.581Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "29ee4c75-57f1-4cf9-a14c-92344f8b2dbb" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.22:48770 10.134.0.22:443 10.132.0.9:41262 - v1-completions-path [2026-11-04T07:36:49.698Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 68 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ba23b36d-bdbf-43c2-a723-de8fb6d5e260" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.22:58850 10.134.0.22:443 10.132.0.9:41266 - v1-completions-path [2026-11-04T07:36:56.464Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 7 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "2a9e0705-5cae-4d03-ba9b-455462d0c3eb" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.22:443 10.132.0.9:43626 - - 2026-11-04T07:37:39.455088Z info ads ADS: new connection for node:3 2026-11-04T07:37:39.460515Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T07:37:39.460573Z info cache read certificate from file resource=file-root:system 2026-11-04T07:37:39.640808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:37:50.399802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:38:02.983268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:38:11.615783Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: gRPC status code is not OK thread=24 [2026-11-04T07:38:09.613Z] "POST /maas-api/v1/api-keys HTTP/1.1" 500 - - "-" 66 23 2003 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "bcf618e0-b9c0-4883-bd41-ba0926c0b828" "maas.apps.162306315d9dd0b1d90f.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.22:443 10.132.0.9:58496 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T07:38:44.402416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:39:00.089128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:40:24.342254Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:40:35.972320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:41:01.904604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:41:10.800042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:41:20.089430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:41:32.454116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:41:47.716471Z info ads ADS: "" 3 terminated 2026-11-04T07:41:47.773591Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T07:41:56.082303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8