2026-10-30T06:26:26.465909Z info FLAG: --concurrency="0" 2026-10-30T06:26:26.465928Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T06:26:26.465933Z info FLAG: --help="false" 2026-10-30T06:26:26.465935Z info FLAG: --log_as_json="false" 2026-10-30T06:26:26.465937Z info FLAG: --log_caller="" 2026-10-30T06:26:26.465939Z info FLAG: --log_output_level="default:info" 2026-10-30T06:26:26.465941Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T06:26:26.465946Z info FLAG: --log_target="[stdout]" 2026-10-30T06:26:26.465948Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T06:26:26.465950Z info FLAG: --outlierLogPath="" 2026-10-30T06:26:26.465952Z info FLAG: --profiling="true" 2026-10-30T06:26:26.465954Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T06:26:26.465956Z info FLAG: --proxyLogLevel="warning" 2026-10-30T06:26:26.465958Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T06:26:26.465960Z info FLAG: --stsPort="0" 2026-10-30T06:26:26.465962Z info FLAG: --templateFile="" 2026-10-30T06:26:26.465963Z info FLAG: --tokenManagerPlugin="" 2026-10-30T06:26:26.465966Z info FLAG: --vklog="0" 2026-10-30T06:26:26.465968Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T06:26:26.466117Z info Proxy role ips=[10.132.0.219] type=router id=maas-default-gateway-openshift-default-84587756dc-q5bls.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T06:26:26.466169Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T06:26:26.467249Z info cpu limit detected as 2, setting concurrency 2026-10-30T06:26:26.467492Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T06:26:26.467504Z info JWT policy is third-party-jwt 2026-10-30T06:26:26.467507Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T06:26:26.469027Z info Starting default Istio SDS Server 2026-10-30T06:26:26.469050Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T06:26:26.469074Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T06:26:26.469562Z info Opening status port 15020 2026-10-30T06:26:26.470009Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T06:26:26.470839Z info sds Starting SDS grpc server 2026-10-30T06:26:26.470858Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T06:26:26.472664Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T06:26:26.473942Z info Starting proxy agent 2026-10-30T06:26:26.473977Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T06:26:26.562352Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T06:26:26.675766Z info ads ADS: new connection for node:1 2026-10-30T06:26:26.676380Z info ads ADS: new connection for node:2 2026-10-30T06:26:26.784106Z info cache generated new workload certificate resourceName=default latency=312.952642ms ttl=23h59m59.215900234s 2026-10-30T06:26:26.784150Z info cache Root cert has changed, start rotating root cert 2026-10-30T06:26:26.784198Z info cache returned workload trust anchor from cache ttl=23h59m59.215803742s 2026-10-30T06:26:26.784217Z info cache returned workload certificate from cache ttl=23h59m59.215783846s 2026-10-30T06:26:26.784316Z info cache returned workload trust anchor from cache ttl=23h59m59.215688268s 2026-10-30T06:26:26.784668Z info cache returned workload trust anchor from cache ttl=23h59m59.215333249s 2026-10-30T06:26:26.880590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:26:35.014645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:26:36.058655Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T06:26:37.783395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:26:38.640655Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T06:26:39.153590Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T06:26:41.029492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:26:41.055169Z info Readiness succeeded in 14.591830169s 2026-10-30T06:26:41.055527Z info Envoy proxy is ready 2026-10-30T06:26:49.671946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:26:54.776747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:26:54.776785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:26:54.776799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T06:26:54.776804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T06:26:54.695Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 81 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "47538877-6bc6-4021-93a2-20a7ddd67387" "maas.apps.3b714319aaccfb1f8a93.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.219:52096 10.132.0.219:443 10.132.0.20:56104 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T06:26:55.033Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 71 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "40c34acc-4b57-4e9c-abee-19475128bc6a" "maas.apps.3b714319aaccfb1f8a93.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.219:33106 10.132.0.219:443 10.132.0.20:56114 - v1-completions-path [2026-10-30T06:26:56.077Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "b6f230ba-e4e3-4009-ac03-fb9dc28acb99" "maas.apps.3b714319aaccfb1f8a93.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.219:33106 10.132.0.219:443 10.132.0.20:53228 - v1-completions-path 2026-10-30T06:27:12.671363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:27:23.122218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:27:27.238922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:27:31.661187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T06:27:31.655Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "f8cb5796-5cc5-4063-af70-a4f4464e3678" "maas.apps.3b714319aaccfb1f8a93.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.219:33106 10.132.0.219:443 10.132.0.20:53186 - v1-completions-path [2026-10-30T06:27:32.424Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 75 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "302d563e-a9c0-4318-bde5-ca0cdbdf0d37" "maas.apps.3b714319aaccfb1f8a93.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.219:40998 10.132.0.219:443 10.132.0.20:53190 - v1-completions-path 2026-10-30T06:27:44.686498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:27:46.771734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:27:52.171990Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T06:28:06.209366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:28:10.713270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:28:26.304715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:28:28.440284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:28:46.442612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:28:57.340145Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:29:00.573683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:29:18.324647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:29:20.888950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:29:26.783424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:29:26.783482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:29:26.783496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T06:29:26.783501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T06:29:26.716Z] "DELETE /v1/api-keys/0443ddb0-52e9-4505-9e7c-42a1bc1b15d6 HTTP/1.1" 404 - via_upstream - "-" 0 29 67 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "4b3f095b-4133-4eac-9067-9feb2ef79a2e" "maas.apps.3b714319aaccfb1f8a93.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.219:43478 10.132.0.219:443 10.132.0.20:36686 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:29:41.929178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:29:44.594569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:31:20.685707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:31:24.043212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:32:54.459089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T06:32:57.338Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 295 82 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "c500b42c-9e3a-46af-92ac-edf43ec6d44a" "maas.apps.3b714319aaccfb1f8a93.prod.konflux-ocp-ci.dev" "10.134.0.25:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.219:33840 10.132.0.219:443 10.132.0.20:52972 - v1-completions-path 2026-10-30T06:33:09.986059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:33:12.090291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:33:27.073429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:34:45.002558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:35:00.421003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:35:16.379852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:35:30.653774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:35:34.046803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:35:46.440774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:35:50.006578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:35:58.033659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T06:35:58.033696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T06:35:58.033711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T06:35:58.033717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T06:35:57.980Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 525 52 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "1c18df69-853e-4114-802d-114c23a90145" "maas.apps.3b714319aaccfb1f8a93.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.219:49470 10.132.0.219:443 10.132.0.20:60482 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:36:09.851426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:36:19.554484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:36:27.694881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:36:41.642981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:36:43.693289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:36:58.468408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T06:37:09.547741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8