2026-10-30T22:01:12.785930Z info FLAG: --concurrency="0" 2026-10-30T22:01:12.785950Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T22:01:12.785954Z info FLAG: --help="false" 2026-10-30T22:01:12.785957Z info FLAG: --log_as_json="false" 2026-10-30T22:01:12.785959Z info FLAG: --log_caller="" 2026-10-30T22:01:12.785961Z info FLAG: --log_output_level="default:info" 2026-10-30T22:01:12.785963Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T22:01:12.785968Z info FLAG: --log_target="[stdout]" 2026-10-30T22:01:12.785970Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T22:01:12.785972Z info FLAG: --outlierLogPath="" 2026-10-30T22:01:12.785974Z info FLAG: --profiling="true" 2026-10-30T22:01:12.785976Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T22:01:12.785978Z info FLAG: --proxyLogLevel="warning" 2026-10-30T22:01:12.785980Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T22:01:12.785982Z info FLAG: --stsPort="0" 2026-10-30T22:01:12.785984Z info FLAG: --templateFile="" 2026-10-30T22:01:12.785986Z info FLAG: --tokenManagerPlugin="" 2026-10-30T22:01:12.785989Z info FLAG: --vklog="0" 2026-10-30T22:01:12.785991Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T22:01:12.786130Z info Proxy role ips=[10.134.1.11] type=router id=maas-default-gateway-openshift-default-57f78bcd55-xgns5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T22:01:12.786173Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T22:01:12.787594Z info cpu limit detected as 2, setting concurrency 2026-10-30T22:01:12.787911Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T22:01:12.787926Z info JWT policy is third-party-jwt 2026-10-30T22:01:12.787930Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T22:01:12.790326Z info Starting default Istio SDS Server 2026-10-30T22:01:12.790360Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T22:01:12.790384Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T22:01:12.790340Z info Opening status port 15020 2026-10-30T22:01:12.790931Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T22:01:12.791681Z info sds Starting SDS grpc server 2026-10-30T22:01:12.791702Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T22:01:12.792366Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T22:01:12.793169Z info Starting proxy agent 2026-10-30T22:01:12.793210Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T22:01:12.869281Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T22:01:13.005432Z info ads ADS: new connection for node:1 2026-10-30T22:01:13.006498Z info ads ADS: new connection for node:2 2026-10-30T22:01:13.012633Z info cache generated new workload certificate resourceName=default latency=220.776592ms ttl=23h59m59.987371241s 2026-10-30T22:01:13.012665Z info cache Root cert has changed, start rotating root cert 2026-10-30T22:01:13.012699Z info cache returned workload trust anchor from cache ttl=23h59m59.987301958s 2026-10-30T22:01:13.012718Z info cache returned workload certificate from cache ttl=23h59m59.987282112s 2026-10-30T22:01:13.012825Z info cache returned workload trust anchor from cache ttl=23h59m59.987180747s 2026-10-30T22:01:13.013070Z info cache returned workload trust anchor from cache ttl=23h59m59.986931685s 2026-10-30T22:01:13.100867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:01:21.406418Z info Readiness succeeded in 8.623106712s 2026-10-30T22:01:21.406731Z info Envoy proxy is ready 2026-10-30T22:01:35.124106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:01:45.529628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:01:50.523272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:01:53.943Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 131 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "8cefd60f-f5c6-40f4-9686-970d15034c80" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:55082 10.134.1.11:443 10.132.0.20:47132 - v1-completions-path 2026-10-30T22:01:54.399225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T22:01:54.185Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "8edef7b9-9bbd-4bd1-bed5-f5eb29a76b49" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:55082 10.134.1.11:443 10.132.0.20:47148 - v1-completions-path [2026-10-30T22:01:54.270Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "af0436a8-5c3e-4675-b0e4-c0c50aea5846" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:55082 10.134.1.11:443 10.132.0.20:47152 - v1-completions-path [2026-10-30T22:01:54.346Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "2a82d9d3-b5e0-4f89-bd9b-8a2bf7bbf91c" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:55082 10.134.1.11:443 10.132.0.20:47156 - v1-completions-path [2026-10-30T22:01:54.681Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "c41325b7-6d5c-4270-95ec-407924f5dbc2" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:55090 10.134.1.11:443 10.132.0.20:47160 - v1-completions-path 2026-10-30T22:02:06.948524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:09.356571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:28.446394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:30.864396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:50.537727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:03:05.247Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 77 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "e44a6e48-5f6c-4ea8-8f7d-df7a34c05eb5" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:49546 10.134.1.11:443 10.132.0.20:49632 - v1-completions-path 2026-10-30T22:03:06.640460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:03:17.263914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:03:20.301748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:03:41.307179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:03:41.307215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:03:41.307231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:03:41.307236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T22:03:41.231Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 332 76 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "c45e6ba8-f1a3-478a-9f09-57e1799dcf5f" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.11:49014 10.134.1.11:443 10.132.0.20:38672 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:03:48.727851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:04:06.862123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:04:17.278595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:07:48.773630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:07:52.021800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:07:52.021834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:07:52.021847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:07:52.021852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:07:51.948Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 73 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "0a679cef-8e67-4812-91c8-4b599105e3ce" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.11:35652 10.134.1.11:443 10.132.0.20:57982 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:08:03.992205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:06.397910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:13.013064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T22:08:12.948Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 66 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "bf077436-b1e5-458a-9858-b3ac10d73f04" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:49546 10.134.1.11:443 10.132.0.20:36216 - v1-completions-path 2026-10-30T22:08:25.383182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:09:56.764432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:10:11.479197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:10:27.083207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:10:39.271123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:10:42.319303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:10:42.319346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:10:42.319363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:10:42.319370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:10:42.256Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 63 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "bc9d9cf0-f6cb-42e4-b064-b6d0ebd76c8e" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.11:37524 10.134.1.11:443 10.132.0.20:38898 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:10:43.350570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:10:54.268431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:10:58.038860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:11:05.559Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "e87efdc7-269c-4e2d-9d45-beb6f79847b6" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.11:443 10.132.0.20:40870 - v1-completions-path 2026-10-30T22:11:17.723172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:14:09.015138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:14:14.392945Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T22:14:14.313Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 79 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "ed9032a3-bbbf-45b9-9c75-e210b5eb9581" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:44114 10.134.1.11:443 10.132.0.20:43536 - v1-catch-all-path 2026-10-30T22:14:17.311985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:14:22.958436Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T22:14:22.894Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 63 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "41719943-b79d-450e-902a-366f3a6511a8" "maas.apps.f0a10dd678f1a9884783.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.11:43740 10.134.1.11:443 10.132.0.20:43674 - v1-catch-all-path 2026-10-30T22:14:35.266074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:14:37.791703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:14:52.465024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:15:03.414709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8