2026-10-30T00:55:08.109558Z info FLAG: --concurrency="0" 2026-10-30T00:55:08.109577Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T00:55:08.109581Z info FLAG: --help="false" 2026-10-30T00:55:08.109583Z info FLAG: --log_as_json="false" 2026-10-30T00:55:08.109586Z info FLAG: --log_caller="" 2026-10-30T00:55:08.109588Z info FLAG: --log_output_level="default:info" 2026-10-30T00:55:08.109590Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T00:55:08.109595Z info FLAG: --log_target="[stdout]" 2026-10-30T00:55:08.109597Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T00:55:08.109599Z info FLAG: --outlierLogPath="" 2026-10-30T00:55:08.109601Z info FLAG: --profiling="true" 2026-10-30T00:55:08.109603Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T00:55:08.109605Z info FLAG: --proxyLogLevel="warning" 2026-10-30T00:55:08.109607Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T00:55:08.109609Z info FLAG: --stsPort="0" 2026-10-30T00:55:08.109611Z info FLAG: --templateFile="" 2026-10-30T00:55:08.109613Z info FLAG: --tokenManagerPlugin="" 2026-10-30T00:55:08.109615Z info FLAG: --vklog="0" 2026-10-30T00:55:08.109618Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T00:55:08.109778Z info Proxy role ips=[10.133.0.44] type=router id=maas-default-gateway-openshift-default-67bf986f99-pwmfm.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T00:55:08.109828Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T00:55:08.110894Z info cpu limit detected as 2, setting concurrency 2026-10-30T00:55:08.111467Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T00:55:08.111479Z info JWT policy is third-party-jwt 2026-10-30T00:55:08.111482Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T00:55:08.113034Z info Starting default Istio SDS Server 2026-10-30T00:55:08.113058Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T00:55:08.113078Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T00:55:08.113483Z info Opening status port 15020 2026-10-30T00:55:08.114295Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T00:55:08.114994Z info sds Starting SDS grpc server 2026-10-30T00:55:08.115013Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T00:55:08.116007Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T00:55:08.117050Z info Starting proxy agent 2026-10-30T00:55:08.117098Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T00:55:08.185425Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T00:55:08.274837Z info cache generated new workload certificate resourceName=default latency=159.724999ms ttl=23h59m59.725167279s 2026-10-30T00:55:08.274886Z info cache Root cert has changed, start rotating root cert 2026-10-30T00:55:08.274917Z info cache returned workload trust anchor from cache ttl=23h59m59.725084099s 2026-10-30T00:55:08.312252Z info ads ADS: new connection for node:1 2026-10-30T00:55:08.312307Z info cache returned workload certificate from cache ttl=23h59m59.687693982s 2026-10-30T00:55:08.313117Z info ads ADS: new connection for node:2 2026-10-30T00:55:08.313208Z info cache returned workload trust anchor from cache ttl=23h59m59.686793591s 2026-10-30T00:55:08.401205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:55:16.460363Z info Readiness succeeded in 8.352982037s 2026-10-30T00:55:16.460692Z info Envoy proxy is ready [2026-10-30T00:55:23.902Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 419 81 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "546e5de1-e4eb-49d3-8db1-4816572c09bf" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:45050 10.133.0.44:443 10.132.0.13:36226 - v1-model-routing [2026-10-30T00:55:24.112Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 443 54 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "e42cea74-419a-4e89-90a8-a8197c17dd8d" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:45050 10.133.0.44:443 10.132.0.13:36228 - v1-model-routing 2026-10-30T00:55:25.200913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:55:25.200950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:55:25.200965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:55:25.200970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T00:55:24.692Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "4d932df2-c69c-4a6b-a0cf-b05ceb10502b" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 10.132.0.13:36244 - v1-model-routing [2026-10-30T00:55:25.129Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 71 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "251dd265-74b5-40f2-8ed5-1ad4cf9d7859" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:56104 10.133.0.44:443 10.132.0.13:36264 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:57:56.514584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:57:56.514620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:57:56.514635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:57:56.514640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T00:57:56.514647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T00:57:56.416Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 98 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "08c2ad1c-ac0d-479e-9830-8f1b6b864800" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:34530 10.133.0.44:443 10.132.0.13:38812 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:57:56.683924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T00:57:56.683959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T00:57:56.683974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T00:57:56.683979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T00:57:56.831722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:57:56.831787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:57:56.831815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:57:56.831822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T00:57:56.549Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 134 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "29568715-95ba-4e1b-9b2a-565532dc55f1" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:34534 10.133.0.44:443 10.132.0.13:38824 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T00:57:56.725Z] "DELETE /v1/api-keys/41fcb82a-ff0b-41ce-9244-df9b3e13d6a9 HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "1594a2ff-3cc7-46cc-82a4-4a0610aed051" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:34530 10.133.0.44:443 10.132.0.13:38832 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:58:07.018065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:58:21.705948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:02:02.029002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:02:02.029060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:02:02.029086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T01:02:02.029093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T01:02:01.672Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 356 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "45029848-f8d1-4276-b371-6cc1364a0264" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:42240 10.133.0.44:443 10.132.0.13:34264 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:03:07.481541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:03:21.059424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:04:41.539877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:06:28.971227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:08:16.598379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:10:20.637549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:23:51.076982Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T01:32:48.041993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:32:48.756077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:32:48.756118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:32:48.756138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:32:48.756145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T01:32:48.674Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 81 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5a9758f4-a694-4a8a-bce1-fbc2e62ae682" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:60162 10.133.0.44:443 10.132.0.13:54232 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:33:12.224008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:24.057086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:33:24.057122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:33:24.057135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:33:24.057140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T01:33:23.983Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 73 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "1c7b17a8-2085-439e-bdc6-94c9e68c0289" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:53352 10.133.0.44:443 10.132.0.13:33442 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:33:53.697569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:58.847364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:33:58.847400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:33:58.847414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:33:58.847419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T01:33:58.776Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 70 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "aabec86b-c0fb-4024-b7d1-cc012fc30278" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:53352 10.133.0.44:443 10.132.0.13:44914 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T01:33:58.869Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "95484af7-b44f-47ba-bfc4-7111abffdb24" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:46310 10.133.0.44:443 10.132.0.13:44916 - v1-completions-path 2026-10-30T01:34:11.886492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:16.395011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:19.408023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:34:19.408057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:34:19.408071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:34:19.408076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T01:34:19.334Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 73 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "e480836d-78f8-47b0-9975-550340abaf2d" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:59152 10.133.0.44:443 10.132.0.13:42950 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T01:34:19.586Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 52 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "9d2441f3-d9dc-49d4-a14f-42df88e0bf37" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 10.132.0.13:42960 - v1-completions-path [2026-10-30T01:34:30.802Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 114 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "fd998638-c0b6-418c-b8be-8fa4f6d202e1" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:47852 10.133.0.44:443 10.132.0.13:51958 - v1-completions-path 2026-10-30T01:34:31.807887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:34.451644Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:37.258688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:47.566028Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:53.563749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T01:34:53.513Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 54 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5abe12ee-a41b-4581-a715-e81f2f38b5a0" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:46310 10.133.0.44:443 10.132.0.13:57442 - v1-completions-path [2026-10-30T01:34:53.828Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 54 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "1b779628-53fe-4478-83df-67821f7dc1b5" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:46310 10.133.0.44:443 10.132.0.13:57454 - v1-completions-path [2026-10-30T01:34:54.241Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "9046dae4-0d10-4748-a9ce-f30c80e32bfa" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:46310 10.133.0.44:443 10.132.0.13:57460 - v1-completions-path 2026-10-30T01:35:10.601793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:20.976781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:25.405723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:35:29.716Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 55 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "63dddcb1-87c3-4044-938d-c5ac90f17722" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:46310 10.133.0.44:443 10.132.0.13:54066 - v1-completions-path [2026-10-30T01:35:30.039Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 53 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "1f333b56-de47-445d-b59c-9f6ae37c810e" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:46310 10.133.0.44:443 10.132.0.13:54078 - v1-completions-path 2026-10-30T01:35:42.636123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:44.805456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:03.695888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:08.067789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:23.722645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:25.931718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:44.829142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:55.528295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:58.666087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:37:32.495Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "dde962c5-cce5-4abd-bfcc-fae22e15ee41" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 10.132.0.13:49222 - v1-completions-path [2026-10-30T01:39:04.734Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 45 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "70d6be0c-08a4-4bab-9181-496ae73d8ad3" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 10.132.0.13:52472 - v1-completions-path 2026-10-30T01:40:34.794032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:50.087848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:52.288222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:52.726128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:40:52.726164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:40:52.726181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T01:40:52.726187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:40:53.079973Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T01:40:53.079997Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T01:40:53.080000Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T01:40:53.080004Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T01:40:52.633Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 93 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "9dba9ace-c917-428d-ba01-cd1b54c7f0f4" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.44:56532 10.133.0.44:443 10.132.0.13:45246 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T01:40:53.039Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 40 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "c5021069-9e8c-4d63-8bcf-862b308c87a3" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 10.132.0.13:45250 - v1-completions-path 2026-10-30T01:41:05.007351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:42:22.928325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:42:42.093211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:42:55.661540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:08.329096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:11.760363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:15.878443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:26.626166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:30.767545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:49.099150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:58.619208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:03.944224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-10-30T01:44:03.959586Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-30T01:44:03.874Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 85 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "d58ed0df-f590-4056-aeb3-a951a9d36c16" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:59870 10.133.0.44:443 10.132.0.13:43424 - v1-catch-all-path 2026-10-30T01:44:06.533151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:20.793890Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:23.081879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:38.218620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:49.198609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8