2026-10-30T16:31:58.382424Z info FLAG: --concurrency="0" 2026-10-30T16:31:58.382443Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T16:31:58.382455Z info FLAG: --help="false" 2026-10-30T16:31:58.382457Z info FLAG: --log_as_json="false" 2026-10-30T16:31:58.382460Z info FLAG: --log_caller="" 2026-10-30T16:31:58.382462Z info FLAG: --log_output_level="default:info" 2026-10-30T16:31:58.382464Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T16:31:58.382468Z info FLAG: --log_target="[stdout]" 2026-10-30T16:31:58.382470Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T16:31:58.382472Z info FLAG: --outlierLogPath="" 2026-10-30T16:31:58.382474Z info FLAG: --profiling="true" 2026-10-30T16:31:58.382476Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T16:31:58.382478Z info FLAG: --proxyLogLevel="warning" 2026-10-30T16:31:58.382480Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T16:31:58.382482Z info FLAG: --stsPort="0" 2026-10-30T16:31:58.382484Z info FLAG: --templateFile="" 2026-10-30T16:31:58.382485Z info FLAG: --tokenManagerPlugin="" 2026-10-30T16:31:58.382488Z info FLAG: --vklog="0" 2026-10-30T16:31:58.382490Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T16:31:58.382706Z info Proxy role ips=[10.133.0.35] type=router id=maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T16:31:58.382762Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T16:31:58.384071Z info cpu limit detected as 2, setting concurrency 2026-10-30T16:31:58.384321Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T16:31:58.384332Z info JWT policy is third-party-jwt 2026-10-30T16:31:58.384335Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T16:31:58.385695Z info Starting default Istio SDS Server 2026-10-30T16:31:58.385713Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T16:31:58.385730Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T16:31:58.386146Z info Opening status port 15020 2026-10-30T16:31:58.387245Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T16:31:58.387820Z info sds Starting SDS grpc server 2026-10-30T16:31:58.387863Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T16:31:58.388878Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T16:31:58.389976Z info Starting proxy agent 2026-10-30T16:31:58.390006Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T16:31:58.448629Z info cache generated new workload certificate resourceName=default latency=60.688613ms ttl=23h59m59.551373655s 2026-10-30T16:31:58.448694Z info cache Root cert has changed, start rotating root cert 2026-10-30T16:31:58.448729Z info cache returned workload trust anchor from cache ttl=23h59m59.551271781s 2026-10-30T16:31:58.453188Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T16:31:58.571087Z info ads ADS: new connection for node:1 2026-10-30T16:31:58.571160Z info cache returned workload certificate from cache ttl=23h59m59.428842073s 2026-10-30T16:31:58.571704Z info ads ADS: new connection for node:2 2026-10-30T16:31:58.571783Z info cache returned workload trust anchor from cache ttl=23h59m59.428218158s 2026-10-30T16:31:58.652411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:32:06.512011Z info Readiness succeeded in 8.132277822s 2026-10-30T16:32:06.512436Z info Envoy proxy is ready [2026-10-30T16:32:30.258Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 62 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "50cebc48-b58b-49a0-a315-56490790cb03" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 10.132.0.21:43410 - v1-model-routing [2026-10-30T16:32:30.433Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 50 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "995aea59-773f-472a-8b09-8258d71290ac" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 10.132.0.21:48766 - v1-model-routing 2026-10-30T16:32:30.712977Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T16:32:30.713006Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T16:32:30.713011Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T16:32:30.713015Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T16:32:30.692Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 20 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "88f22e63-765d-438c-9bfc-c980c683c1b3" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 10.132.0.21:48772 - v1-model-routing [2026-10-30T16:34:50.794Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 47 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b81fb32f-8544-44f1-a069-76c73951c9d9" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.35:443 10.132.0.21:55770 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:34:52.160754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:52.160789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:52.160804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:52.160809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T16:34:52.030Z] "DELETE /v1/api-keys/40aad873-554f-4dc8-ae1b-a615b49834cb HTTP/1.1" 200 - via_upstream - "-" 0 321 130 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "520eaf3a-71b3-43d4-aa1d-14fc67c602b7" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:38142 10.133.0.35:443 10.132.0.21:55784 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:34:58.482Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 90 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "bf297588-26b0-40fe-9432-905f9662dafb" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:49960 10.133.0.35:443 10.132.0.21:55790 - v1-completions-path [2026-10-30T16:34:59.256Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 9 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f1a093a7-8494-48a0-8378-108637158fbd" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.35:443 10.132.0.21:55798 - - 2026-10-30T16:35:03.471405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:35:03.471440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:35:03.471453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:35:03.471458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T16:35:03.395Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 75 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "ecb5c407-555b-4d45-af7b-86e66999ec04" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:38142 10.133.0.35:443 10.132.0.21:36180 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:35:09.689042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:35:24.296447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:39:58.374924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:40:24.935109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:41:06.381883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:41:23.413257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:41:27.727417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:41:31.226004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:41:31.226041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:41:31.226055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:41:31.226060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T16:41:31.141Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 85 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b5b4b619-c33d-43c9-a993-687b8faf1c7a" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:50880 10.133.0.35:443 10.132.0.21:56944 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:41:43.511551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:41:45.842554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:41:48.672251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:41:57.836436Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:42:05.217422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T16:42:04.854Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 72 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a19f5866-c2fa-49b4-802a-87bd5cee3db5" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:55526 10.133.0.35:443 10.132.0.21:34104 - v1-completions-path [2026-10-30T16:42:04.952Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 54 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c3f1e8c8-9f1f-4722-9a24-74a6194e43c5" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:55526 10.133.0.35:443 10.132.0.21:34108 - v1-completions-path [2026-10-30T16:42:05.212Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f04e930c-30bf-4146-8891-7a82b8b096cd" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:55526 10.133.0.35:443 10.132.0.21:34124 - v1-completions-path [2026-10-30T16:42:05.303Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3951990d-7ba5-499e-933c-a1e61528d7e5" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:33336 10.133.0.35:443 10.132.0.21:34128 - v1-completions-path 2026-10-30T16:42:06.096111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T16:42:05.794Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "6ce98676-1cec-4961-904c-300683fbe675" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:55526 10.133.0.35:443 10.132.0.21:34140 - v1-completions-path [2026-10-30T16:42:05.875Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 56 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "1834cb3a-a4f6-4a94-81e4-34d185e0ad10" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:33336 10.133.0.35:443 10.132.0.21:34146 - v1-completions-path [2026-10-30T16:42:06.046Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 52 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "5edbf12a-5a65-464b-9181-ca7a74fbc183" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:33336 10.133.0.35:443 10.132.0.21:34160 - v1-completions-path 2026-10-30T16:42:21.973530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:42:32.285646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:42:36.657976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T16:42:42.397Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3c6af7f9-bbd7-4d68-ac56-55ec2c1b07d3" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:55526 10.133.0.35:443 10.132.0.21:38670 - v1-completions-path 2026-10-30T16:42:54.660250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:42:56.800577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:43:04.289679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:43:04.289712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:43:04.289726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:43:04.289731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T16:43:04.216Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 314 73 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "0227fab2-c0d8-44bf-a18d-9fa3c3cf9b81" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:41360 10.133.0.35:443 10.132.0.21:52982 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:43:16.206217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:43:21.439825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:43:39.951050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:43:56.991340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:44:07.503485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:44:10.343714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:44:30.133465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:44:32.796335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:44:53.659459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:44:56.384720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:46:33.230737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:46:36.409519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:47:45.727177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:47:45.727217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:47:45.727232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:47:45.727237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T16:47:45.650Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 77 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "c939c649-cee8-4ab5-b542-7311277d622e" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:33142 10.133.0.35:443 10.132.0.21:53384 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:48:06.383430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:48:09.707495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:48:09.707529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:48:09.707542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:48:09.707547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T16:48:08.798Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 290 117 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "8bc15ed4-d889-453a-965a-0fa398c7f882" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:56052 10.133.0.35:443 10.132.0.21:50444 - v1-completions-path [2026-10-30T16:48:09.635Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 72 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "1d2d901e-44a5-42fe-9c13-15e74f61d4df" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:40794 10.133.0.35:443 10.132.0.21:50456 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:48:21.734124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:48:24.005001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:48:24.572145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:48:24.572186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:48:24.572207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:48:24.572214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T16:48:24.476Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 95 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "cffaee56-3106-474b-9aba-2bcaa335c146" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:33142 10.133.0.35:443 10.132.0.21:59878 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:48:24.595Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 80 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "ae2bdd88-2648-471b-b9b9-2cd2ac31b91c" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:47184 10.133.0.35:443 10.132.0.21:59882 - v1-completions-path 2026-10-30T16:48:38.533227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:49:51.093411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:49:51.093450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:49:51.093467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:49:51.093473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T16:49:51.021Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 72 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "63011426-fe36-4be5-a311-f0195d6e8be1" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:58148 10.133.0.35:443 10.132.0.21:49040 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:49:52.556525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:49:52.556561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:49:52.556574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:49:52.556579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T16:49:52.496Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "6bcbe12e-646b-43d9-85bd-7688f2d636aa" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:58154 10.133.0.35:443 10.132.0.21:49052 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:49:57.520162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:50:19.367894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:50:35.109582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:50:35.109625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:50:35.109664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:50:35.109672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:50:35.292681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T16:50:35.032Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 77 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "4907f006-21c6-4503-aa82-ccc67ab8e682" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:58148 10.133.0.35:443 10.132.0.21:42872 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:50:49.421184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:50:54.027458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:50:54.395822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:50:54.395874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:50:54.395895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:50:54.395903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T16:50:54.311Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 84 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "f4c68d9a-f92d-4ce8-b73a-617c11740e28" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.35:58148 10.133.0.35:443 10.132.0.21:36392 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:51:06.488412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:51:10.025534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:51:29.850213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:51:37.396622Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T16:51:37.396664Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T16:51:37.396668Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T16:51:37.396673Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T16:51:37.326Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 70 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "d44f3ff7-913f-492b-be6d-660ac1319552" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 10.132.0.21:40984 - v1-catch-all-path 2026-10-30T16:51:39.774384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:51:47.975904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:52:01.281794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:52:12.731826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:52:27.459280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T16:52:38.380522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8