2026-10-30T13:46:11.078378Z info FLAG: --concurrency="0" 2026-10-30T13:46:11.078405Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T13:46:11.078410Z info FLAG: --help="false" 2026-10-30T13:46:11.078412Z info FLAG: --log_as_json="false" 2026-10-30T13:46:11.078414Z info FLAG: --log_caller="" 2026-10-30T13:46:11.078417Z info FLAG: --log_output_level="default:info" 2026-10-30T13:46:11.078419Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T13:46:11.078423Z info FLAG: --log_target="[stdout]" 2026-10-30T13:46:11.078426Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T13:46:11.078427Z info FLAG: --outlierLogPath="" 2026-10-30T13:46:11.078429Z info FLAG: --profiling="true" 2026-10-30T13:46:11.078432Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T13:46:11.078434Z info FLAG: --proxyLogLevel="warning" 2026-10-30T13:46:11.078436Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T13:46:11.078438Z info FLAG: --stsPort="0" 2026-10-30T13:46:11.078440Z info FLAG: --templateFile="" 2026-10-30T13:46:11.078441Z info FLAG: --tokenManagerPlugin="" 2026-10-30T13:46:11.078444Z info FLAG: --vklog="0" 2026-10-30T13:46:11.078446Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T13:46:11.078580Z info Proxy role ips=[10.133.1.10] type=router id=maas-default-gateway-openshift-default-64d4cc998c-wfkdb.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T13:46:11.078636Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T13:46:11.079753Z info cpu limit detected as 2, setting concurrency 2026-10-30T13:46:11.079946Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T13:46:11.079957Z info JWT policy is third-party-jwt 2026-10-30T13:46:11.079960Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T13:46:11.082149Z info Starting default Istio SDS Server 2026-10-30T13:46:11.082172Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T13:46:11.082195Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T13:46:11.082774Z info Opening status port 15020 2026-10-30T13:46:11.083228Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T13:46:11.083959Z info sds Starting SDS grpc server 2026-10-30T13:46:11.083974Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T13:46:11.084472Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T13:46:11.085263Z info Starting proxy agent 2026-10-30T13:46:11.085292Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T13:46:11.150472Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T13:46:11.216909Z info cache generated new workload certificate resourceName=default latency=132.824413ms ttl=23h59m59.78309374s 2026-10-30T13:46:11.216943Z info cache Root cert has changed, start rotating root cert 2026-10-30T13:46:11.216973Z info cache returned workload trust anchor from cache ttl=23h59m59.783027724s 2026-10-30T13:46:11.265184Z info ads ADS: new connection for node:1 2026-10-30T13:46:11.265255Z info cache returned workload certificate from cache ttl=23h59m59.734746869s 2026-10-30T13:46:11.265574Z info ads ADS: new connection for node:2 2026-10-30T13:46:11.265660Z info cache returned workload trust anchor from cache ttl=23h59m59.734341644s 2026-10-30T13:46:11.346320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:19.286038Z info Readiness succeeded in 8.209872818s 2026-10-30T13:46:19.286435Z info Envoy proxy is ready 2026-10-30T13:46:20.261797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:03.923452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:47:09.723Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 82 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "f516f232-dd23-4bc9-95c3-38de8d16a716" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.10:54698 10.133.1.10:443 10.132.0.12:38818 - v1-completions-path [2026-10-30T13:47:09.930Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 53 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "4ea7fdb3-74dc-4c35-9ae6-76d9814953a6" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.10:54698 10.133.1.10:443 10.132.0.12:38828 - v1-completions-path 2026-10-30T13:47:22.014314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:26.430129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:42.317472Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:44.720887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:47.664155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:57.940501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:48:04.701Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 70 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "43eaa938-46bb-4485-a1c9-a2ff741d02ea" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.10:41194 10.133.1.10:443 10.132.0.12:54452 - v1-completions-path 2026-10-30T13:48:21.410846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:48:31.866588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:48:36.003060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:48:40.070Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "d6f7dd68-7068-407e-b534-15b45c15c1a7" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.10:54698 10.133.1.10:443 10.132.0.12:43768 - v1-completions-path 2026-10-30T13:48:40.646245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T13:48:40.593Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 55 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "ea47ce1c-e2f3-48aa-a785-4a408a9c2b5a" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.10:54698 10.133.1.10:443 10.132.0.12:43780 - v1-completions-path [2026-10-30T13:48:40.679Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 54 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "5ef1843d-5c9c-469f-911e-28b8f3f47c08" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.10:54698 10.133.1.10:443 10.132.0.12:56910 - v1-completions-path [2026-10-30T13:48:41.099Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "5a4fc4a9-b5db-4331-bd6b-f2048682513d" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.10:41194 10.133.1.10:443 10.132.0.12:56918 - v1-completions-path 2026-10-30T13:48:53.336790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:48:55.587937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:49:14.949540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:49:19.567587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:49:33.756Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 75 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "cae2a935-e70b-45b7-b384-da4195bf762c" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.10:58688 10.133.1.10:443 10.132.0.12:56412 - v1-completions-path 2026-10-30T13:49:36.096398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:49:53.232311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:50:04.024057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:50:06.933039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:50:26.186409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:50:28.805617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:50:34.833434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:50:34.833472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:50:34.833488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:50:34.833493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:50:34.759Z] "DELETE /v1/api-keys/49796215-57a6-4658-ac65-d9cb199a7cc1 HTTP/1.1" 200 - via_upstream - "-" 0 375 73 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "36a13e79-c733-4561-bd5a-72c9634f9477" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.10:47458 10.133.1.10:443 10.132.0.12:39944 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:50:50.169591Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:50:52.815004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:52:29.443870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:52:32.674446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:02.143405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:17.356212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:19.446943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:34.284072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:52.550866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:56:10.080349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:56:30.628317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:56:30.754272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:56:30.754324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:56:30.754349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:56:30.754357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:56:30.754367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T13:56:30.638Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 115 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "4de78ee8-ba92-4806-a393-cfc701a41615" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.10:41240 10.133.1.10:443 10.132.0.12:56490 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:56:45.037871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:56:51.213298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:03.482191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:07.472297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:57:11.757Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "31184593-2bab-41d8-82b4-b1d49e6d7088" "maas.apps.d756d99ddd8cfe27ef62.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.10:443 10.132.0.12:35958 - v1-completions-path 2026-10-30T13:57:23.782454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:33.753525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:42.012694Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:55.652391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:57.784861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:10.512824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:21.242571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8