2026-10-30T18:08:28.911450Z info FLAG: --concurrency="0" 2026-10-30T18:08:28.911468Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T18:08:28.911472Z info FLAG: --help="false" 2026-10-30T18:08:28.911474Z info FLAG: --log_as_json="false" 2026-10-30T18:08:28.911476Z info FLAG: --log_caller="" 2026-10-30T18:08:28.911478Z info FLAG: --log_output_level="default:info" 2026-10-30T18:08:28.911480Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T18:08:28.911484Z info FLAG: --log_target="[stdout]" 2026-10-30T18:08:28.911486Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T18:08:28.911488Z info FLAG: --outlierLogPath="" 2026-10-30T18:08:28.911490Z info FLAG: --profiling="true" 2026-10-30T18:08:28.911492Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T18:08:28.911494Z info FLAG: --proxyLogLevel="warning" 2026-10-30T18:08:28.911496Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T18:08:28.911498Z info FLAG: --stsPort="0" 2026-10-30T18:08:28.911500Z info FLAG: --templateFile="" 2026-10-30T18:08:28.911502Z info FLAG: --tokenManagerPlugin="" 2026-10-30T18:08:28.911505Z info FLAG: --vklog="0" 2026-10-30T18:08:28.911507Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T18:08:28.911686Z info Proxy role ips=[10.132.0.52] type=router id=maas-default-gateway-openshift-default-77f556d647-n789k.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T18:08:28.911730Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T18:08:28.912843Z info cpu limit detected as 2, setting concurrency 2026-10-30T18:08:28.913044Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T18:08:28.913055Z info JWT policy is third-party-jwt 2026-10-30T18:08:28.913058Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T18:08:28.914292Z info Starting default Istio SDS Server 2026-10-30T18:08:28.914326Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T18:08:28.914343Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T18:08:28.914642Z info Opening status port 15020 2026-10-30T18:08:28.916076Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T18:08:28.917522Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T18:08:28.918530Z info Starting proxy agent 2026-10-30T18:08:28.918567Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T18:08:28.926735Z info sds Starting SDS grpc server 2026-10-30T18:08:28.926775Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T18:08:28.990018Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T18:08:29.010909Z info cache generated new workload certificate resourceName=default latency=94.596544ms ttl=23h59m59.989094917s 2026-10-30T18:08:29.010949Z info cache Root cert has changed, start rotating root cert 2026-10-30T18:08:29.010987Z info cache returned workload trust anchor from cache ttl=23h59m59.989013197s 2026-10-30T18:08:29.095389Z info ads ADS: new connection for node:1 2026-10-30T18:08:29.095464Z info cache returned workload certificate from cache ttl=23h59m59.90453842s 2026-10-30T18:08:29.096047Z info ads ADS: new connection for node:2 2026-10-30T18:08:29.096136Z info cache returned workload trust anchor from cache ttl=23h59m59.903865869s 2026-10-30T18:08:29.145397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:08:35.512874Z info Readiness succeeded in 6.60428013s 2026-10-30T18:08:35.513210Z info Envoy proxy is ready 2026-10-30T18:08:54.487678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:08:56.553589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:08:58.910824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:09:02.272512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:09:08.136064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:09:31.160245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:09:32.313189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:10:07.042Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 396 115 - "34.228.250.194,10.132.0.10" "curl/7.76.1" "bbd6e6fe-0a69-49f3-90c2-fa05f2af0022" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.134.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:49916 10.132.0.52:443 10.132.0.10:41542 - v1-model-routing 2026-10-30T18:10:07.994183Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:10:07.994213Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:10:07.994216Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:10:07.994220Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T18:10:07.966Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 27 - "34.228.250.194,10.132.0.10" "curl/7.76.1" "8443a0d8-e1ef-43af-84a5-822dfa524187" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.52:443 10.132.0.10:41554 - v1-model-routing 2026-10-30T18:13:17.206795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:17.206848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:17.206865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:13:17.206870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T18:13:16.711Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 495 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4d3b6587-07cc-4c39-a2fe-be1022783e0d" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:56246 10.132.0.52:443 10.132.0.10:57026 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:13:20.095659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:20.095697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:20.095712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:20.095717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T18:13:19.204Z] "DELETE /v1/api-keys/dc5a6859-7a0d-48cd-bfc0-dd5f1aed7714 HTTP/1.1" 200 - via_upstream - "-" 0 321 891 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "1c2e9b63-16a1-46a8-9bf9-845c856f7bee" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:56246 10.132.0.52:443 10.132.0.10:57036 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T18:13:20.383Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 124 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "d95deb81-0f33-4855-a086-2782ecd1c7c0" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.52:443 10.132.0.10:57048 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:13:21.584352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:21.584389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:21.584404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:13:21.584409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T18:13:21.039Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 145 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "778f98ab-c63e-44ac-8de5-c62df17c6830" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.52:443 10.132.0.10:57060 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T18:13:21.206Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 377 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "edd45cb7-5019-445c-9a3d-1eb4e36d8007" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:56246 10.132.0.52:443 10.132.0.10:57070 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T18:13:21.990Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 81 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4007a43f-8424-4b03-95b0-fa8037afdb2b" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.52:443 10.132.0.10:57090 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:13:36.277391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:13:46.054676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T18:13:45.884Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 185 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "dda7af80-9462-47cc-9aec-c9a43a5a1714" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.134.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:49916 10.132.0.52:443 10.132.0.10:44736 - v1-completions-path 2026-10-30T18:14:00.311897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:17:33.077098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:17:33.077137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:17:33.077149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:17:33.077154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T18:17:33.077326Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-30T18:17:33.077400Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:17:33.077410Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:17:33.077412Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:17:33.077416Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T18:17:32.981Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 95 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e81d51da-21ee-4bce-a0d3-388e7268dcc2" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.134.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:43698 10.132.0.52:443 10.132.0.10:46172 - v1-completions-path 2026-10-30T18:18:41.947852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:20:07.875893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:20:52.913734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:23:30.815329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:26:24.106814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:26:49.971632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:27:56.424250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:28:18.281967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:28:50.508555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:34:29.297300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:34:29.537704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:34:29.537752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:34:29.537775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:34:29.537784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T18:34:29.395Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 142 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e8574b9e-df5a-4939-825d-f9df82bdcc9d" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:46796 10.132.0.52:443 10.132.0.10:40350 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:34:52.846092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:34:56.578721Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T18:35:03.044712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:35:03.044748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:35:03.044761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:35:03.044777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T18:35:02.863Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 181 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "5cf56640-55ee-413d-b0dd-d65849dd9cb2" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:34282 10.132.0.52:443 10.132.0.10:46572 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:35:46.458333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:35:53.481Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 109 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "3ff4817f-c032-4f37-95eb-453a3bdefa10" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:48104 10.132.0.52:443 10.132.0.10:57080 - v1-completions-path 2026-10-30T18:36:07.134389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:36:11.186502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:36:20.993927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:36:20.993967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:36:20.993981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:36:20.993986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T18:36:20.906Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 87 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8b1ec50b-9012-4ace-a979-b35c1cc6f2f7" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:48104 10.132.0.52:443 10.132.0.10:49190 - v1-catch-all-path [2026-10-30T18:36:32.227Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 118 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "0f0d48f8-330c-438c-abb1-8f26f53f111d" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.134.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:42038 10.132.0.52:443 10.132.0.10:55478 - v1-completions-path 2026-10-30T18:36:33.507573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:36:36.478349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:36:40.290792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:36:48.703336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:36:54.236038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:36:54.236080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:36:54.236098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:36:54.236103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T18:36:54.127Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 108 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "9b1ff039-8f34-4f04-8d08-cf6a8fc37753" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:47078 10.132.0.52:443 10.132.0.10:33122 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:37:13.746398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:37:24.128785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:37:28.889433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:37:37.087Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 87 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "362f406a-d771-474b-be85-e79b1c87ab39" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:48104 10.132.0.52:443 10.132.0.10:42378 - v1-completions-path 2026-10-30T18:37:49.584359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:37:52.650334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:38:02.116Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 298 111 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "62bfdabe-acf9-4a1b-852e-1caf6ee80ce3" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.134.0.48:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:50170 10.132.0.52:443 10.132.0.10:34012 - v1-completions-path 2026-10-30T18:38:14.772042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:38:17.719202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:38:39.928866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:38:59.039121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:39:09.905588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:39:12.553703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:39:21.878Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 94 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "3786459f-d66a-4ada-b024-cd805eff7356" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.134.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:53092 10.132.0.52:443 10.132.0.10:43472 - v1-completions-path 2026-10-30T18:39:36.568249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:39:36.568281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T18:39:36.568304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:39:36.568332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T18:39:36.568339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T18:39:36.409Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 158 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "afa9c34f-6412-4a04-96f2-d798fe66c76f" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:47634 10.132.0.52:443 10.132.0.10:47928 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:39:43.601937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:40:02.419448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:40:12.639056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:43:41.816195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:43:58.953678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:44:01.703625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:44:23.602835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:45:53.108297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:46:10.502889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:46:23.175840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:46:23.175878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:46:23.175894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:46:23.175899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T18:46:23.071Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 104 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "98906bb8-48bc-4b22-9cae-1861fe282b80" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:55006 10.132.0.52:443 10.132.0.10:55036 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:46:25.906852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:46:36.197615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:46:39.542272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:46:45.864487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:46:56.909078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:47:00.579487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:47:11.038Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 85 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "6c84deb8-926a-449c-b151-32495da58b6d" "maas.apps.87a7c298347a4414bb39.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.52:443 10.132.0.10:54120 - v1-completions-path 2026-10-30T18:47:23.630292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:50:17.369248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:50:25.269739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:50:43.387724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:50:46.249839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:50:59.187196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:51:10.055940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8