2026-10-29T22:50:06.672325Z info FLAG: --concurrency="0" 2026-10-29T22:50:06.672346Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-29T22:50:06.672351Z info FLAG: --help="false" 2026-10-29T22:50:06.672354Z info FLAG: --log_as_json="false" 2026-10-29T22:50:06.672357Z info FLAG: --log_caller="" 2026-10-29T22:50:06.672359Z info FLAG: --log_output_level="default:info" 2026-10-29T22:50:06.672362Z info FLAG: --log_stacktrace_level="default:none" 2026-10-29T22:50:06.672369Z info FLAG: --log_target="[stdout]" 2026-10-29T22:50:06.672373Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-29T22:50:06.672376Z info FLAG: --outlierLogPath="" 2026-10-29T22:50:06.672379Z info FLAG: --profiling="true" 2026-10-29T22:50:06.672382Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-29T22:50:06.672384Z info FLAG: --proxyLogLevel="warning" 2026-10-29T22:50:06.672387Z info FLAG: --serviceCluster="istio-proxy" 2026-10-29T22:50:06.672390Z info FLAG: --stsPort="0" 2026-10-29T22:50:06.672392Z info FLAG: --templateFile="" 2026-10-29T22:50:06.672395Z info FLAG: --tokenManagerPlugin="" 2026-10-29T22:50:06.672399Z info FLAG: --vklog="0" 2026-10-29T22:50:06.672402Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-29T22:50:06.672563Z info Proxy role ips=[10.132.0.61] type=router id=maas-default-gateway-openshift-default-9dccdc9b7-rt2xq.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-29T22:50:06.672620Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-29T22:50:06.673697Z info cpu limit detected as 2, setting concurrency 2026-10-29T22:50:06.673938Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-29T22:50:06.673951Z info JWT policy is third-party-jwt 2026-10-29T22:50:06.673955Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-29T22:50:06.676788Z info Starting default Istio SDS Server 2026-10-29T22:50:06.676824Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-29T22:50:06.676869Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-29T22:50:06.676936Z info Opening status port 15020 2026-10-29T22:50:06.677705Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-29T22:50:06.679236Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-29T22:50:06.680171Z info Starting proxy agent 2026-10-29T22:50:06.680209Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-29T22:50:06.688303Z info sds Starting SDS grpc server 2026-10-29T22:50:06.688324Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-29T22:50:06.745100Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-29T22:50:06.814656Z info cache generated new workload certificate resourceName=default latency=136.7776ms ttl=23h59m59.185347505s 2026-10-29T22:50:06.814685Z info cache Root cert has changed, start rotating root cert 2026-10-29T22:50:06.814713Z info cache returned workload trust anchor from cache ttl=23h59m59.185287576s 2026-10-29T22:50:06.846649Z info ads ADS: new connection for node:1 2026-10-29T22:50:06.846744Z info cache returned workload certificate from cache ttl=23h59m59.153257805s 2026-10-29T22:50:06.847060Z info ads ADS: new connection for node:2 2026-10-29T22:50:06.847140Z info cache returned workload trust anchor from cache ttl=23h59m59.152861555s 2026-10-29T22:50:06.907011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:50:13.333630Z info Readiness succeeded in 6.663630266s 2026-10-29T22:50:13.333969Z info Envoy proxy is ready 2026-10-29T22:50:20.695786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:50:58.293796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:51:01.262540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:51:03.657899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:51:06.219387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:51:09.102293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:51:11.603752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:51:14.541028Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:51:35.082741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-29T22:52:09.114Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 378 85 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "fc33cf36-fa58-4f43-b1e6-7e8817279f98" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:50530 10.132.0.61:443 10.132.0.22:58722 - v1-model-routing 2026-10-29T22:52:10.377295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:52:10.377335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:52:10.377351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:52:10.377357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-29T22:52:09.561Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 50 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "47b8f428-739b-485c-b7f6-5d1927a8fad7" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.61:443 10.132.0.22:58732 - v1-model-routing [2026-10-29T22:52:10.362Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 15 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "cf7aa143-d203-4c9e-bed5-d9c751b0323a" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:52556 10.132.0.61:443 10.132.0.22:58736 - odh-ai-gateway-infra.maas-api-route.4 [2026-10-29T22:54:28.834Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 72 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e5cd80a4-1543-4f08-b69b-11eba68fda16" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.61:443 10.132.0.22:51816 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:54:29.930695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:29.930730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:29.930744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:29.930749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:54:30.247091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:30.247124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T22:54:30.247140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T22:54:30.247146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T22:54:29.704Z] "DELETE /v1/api-keys/c8d592dd-ff57-4ee2-a7f7-38587774881b HTTP/1.1" 200 - via_upstream - "-" 0 321 226 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "12865d09-b382-4259-9dce-38d55ca9d6ba" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:52544 10.132.0.61:443 10.132.0.22:46880 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:54:30.124Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 122 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6a4f5e36-76ea-4352-a860-de855b63aa60" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:52560 10.132.0.61:443 10.132.0.22:46892 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:54:30.994Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 846 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "00b463d0-a23b-47bb-8e79-877142fb2cda" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.61:443 10.132.0.22:46904 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:54:33.235611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:33.235657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:33.235678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:54:33.235684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T22:54:33.032Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 96 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "41daba34-a4b4-447c-baa9-6b7c840b7e82" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.61:443 10.132.0.22:46918 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:54:33.145Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 90 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9cde40ca-de90-4a6c-91ba-5bf08a222246" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:52544 10.132.0.61:443 10.132.0.22:46922 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:54:33.727634Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-29T22:54:33.727656Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-29T22:54:33.727659Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-29T22:54:33.727662Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-29T22:54:33.690Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 37 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b0ebf54c-75bf-4db4-b97c-88cfd2ed3a7d" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.61:443 10.132.0.22:46924 - v1-completions-path [2026-10-29T22:54:36.228Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 6 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "623b2f01-be46-4832-8a7a-1f116b8eb592" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.61:443 10.132.0.22:46936 - - 2026-10-29T22:54:36.927732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:36.927770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:36.927785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:54:36.927790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T22:54:36.856Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 70 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9b5fdee6-96a8-4d58-93ed-8b4b74b6d2b1" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:52544 10.132.0.61:443 10.132.0.22:46948 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:54:38.596034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-29T22:54:38.523Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 80 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2b9541b8-3483-462a-80f6-d08f92df5bcf" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:50530 10.132.0.61:443 10.132.0.22:46976 - v1-completions-path [2026-10-29T22:54:38.622Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c591472a-06dc-440c-9dda-d771002bc970" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:35354 10.132.0.61:443 10.132.0.22:46988 - v1-completions-path [2026-10-29T22:54:38.705Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 56 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "8930a870-c921-46ab-b333-a6d0d6192534" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:50530 10.132.0.61:443 10.132.0.22:47000 - v1-completions-path 2026-10-29T22:54:44.092691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:55:00.135222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:58:06.244117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T22:58:06.244333Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-29T22:58:06.041Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 2068 202 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2883f238-4a33-4fe7-9916-da97d8eb32e9" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:35354 10.132.0.61:443 10.132.0.22:59738 - v1-chat-completions-path 2026-10-29T22:59:02.085019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T22:59:17.244780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:02:53.733216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-29T23:02:53.805402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:02:53.805435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:02:53.805451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:02:53.805455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-29T23:02:53.726Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 79 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c61d2f35-506f-4faa-a30d-78bece760d17" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:55976 10.132.0.61:443 10.132.0.22:49538 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:02:55.538515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:03:18.522697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:03:56.947457Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-29T23:03:56.947482Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-29T23:03:56.947485Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-29T23:03:56.947489Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-29T23:03:56.911Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 35 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "490a2fd4-7cf4-4d5f-89d3-c6c738ad9b8f" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.61:443 10.132.0.22:38292 - v1-completions-path 2026-10-29T23:04:01.857727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:04:19.187391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:04:23.495780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:04:39.242312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:04:54.728035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-29T23:05:01.357Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 68 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "779432db-deae-4b72-9e3b-8300e0b3e83a" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:59526 10.132.0.61:443 10.132.0.22:55086 - v1-completions-path 2026-10-29T23:05:18.226113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:05:28.576537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:05:33.092124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-29T23:05:37.174Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e8b5dff7-18c7-4c79-99c7-bce546fa6bed" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:59526 10.132.0.61:443 10.132.0.22:48430 - v1-completions-path 2026-10-29T23:05:50.167889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:05:52.375918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:05:59.707968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:05:59.708002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:05:59.708016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:05:59.708021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T23:05:59.629Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 78 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "504b062a-f772-4588-b563-346f000b17f6" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:48836 10.132.0.61:443 10.132.0.22:57844 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:06:11.672019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:06:16.385875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:06:31.805698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:06:34.075155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:06:52.049037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:07:02.798255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:07:05.718643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:07:12.064133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:07:12.064166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:07:12.064182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T23:07:12.064187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T23:07:11.984Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 79 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "f5259417-3c9f-4bc5-b56d-dbcf2440665a" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:59358 10.132.0.61:443 10.132.0.22:50446 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:07:24.727051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:07:27.391651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:07:35.841589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:07:35.841624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:07:35.841639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:07:35.841644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-29T23:07:35.767Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 74 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9f0a79ae-261b-4fec-924e-f734cbbad19f" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:59358 10.132.0.61:443 10.132.0.22:32876 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:07:48.633297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:07:51.226257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:09:28.021142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:09:31.160519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:11:01.633720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:11:17.086155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:11:19.217217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:11:32.099698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:12:45.195829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:12:45.195886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:12:45.195899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:12:45.195905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-29T23:12:45.118Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 77 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b1717249-e008-4ea5-8ce5-4d4ec9eface5" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:34480 10.132.0.61:443 10.132.0.22:36644 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:12:50.139434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:13:07.265658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:13:22.598573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:13:35.863679Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:13:40.633780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:13:40.633814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:13:40.633826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:13:40.633831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-29T23:13:40.579Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 54 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e360a20e-04d3-4fab-809c-f8797cd919d0" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:34480 10.132.0.61:443 10.132.0.22:36038 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:13:42.642825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:13:52.521477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:14:06.000822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:14:10.582316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:14:10.582357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:14:10.582372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:14:10.582377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T23:14:10.501Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 80 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b3a86b95-b1bc-4abf-a8fa-48140bc26a39" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:59538 10.132.0.61:443 10.132.0.22:60030 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T23:14:10.768Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6e1dad85-ce6b-44f7-a36e-1d7c89063a6d" "maas.apps.677b11485a60f69c1844.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:59526 10.132.0.61:443 10.132.0.22:60046 - v1-completions-path 2026-10-29T23:14:22.956244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:14:33.052970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:14:40.976150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:14:54.949105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:14:57.036707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:15:17.689657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-29T23:15:28.657439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9