2026-10-31T00:04:11.667324Z info FLAG: --concurrency="0" 2026-10-31T00:04:11.667345Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T00:04:11.667349Z info FLAG: --help="false" 2026-10-31T00:04:11.667351Z info FLAG: --log_as_json="false" 2026-10-31T00:04:11.667353Z info FLAG: --log_caller="" 2026-10-31T00:04:11.667355Z info FLAG: --log_output_level="default:info" 2026-10-31T00:04:11.667357Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T00:04:11.667361Z info FLAG: --log_target="[stdout]" 2026-10-31T00:04:11.667363Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T00:04:11.667383Z info FLAG: --outlierLogPath="" 2026-10-31T00:04:11.667387Z info FLAG: --profiling="true" 2026-10-31T00:04:11.667390Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T00:04:11.667393Z info FLAG: --proxyLogLevel="warning" 2026-10-31T00:04:11.667396Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T00:04:11.667398Z info FLAG: --stsPort="0" 2026-10-31T00:04:11.667399Z info FLAG: --templateFile="" 2026-10-31T00:04:11.667401Z info FLAG: --tokenManagerPlugin="" 2026-10-31T00:04:11.667404Z info FLAG: --vklog="0" 2026-10-31T00:04:11.667408Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T00:04:11.667562Z info Proxy role ips=[10.133.0.209] type=router id=maas-default-gateway-openshift-default-5df48fcc99-dlhf9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T00:04:11.667612Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T00:04:11.668817Z info cpu limit detected as 2, setting concurrency 2026-10-31T00:04:11.669088Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T00:04:11.669099Z info JWT policy is third-party-jwt 2026-10-31T00:04:11.669102Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T00:04:11.670819Z info Starting default Istio SDS Server 2026-10-31T00:04:11.670822Z info Opening status port 15020 2026-10-31T00:04:11.670841Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T00:04:11.670863Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T00:04:11.672226Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T00:04:11.673232Z info sds Starting SDS grpc server 2026-10-31T00:04:11.673257Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T00:04:11.673891Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T00:04:11.674768Z info Starting proxy agent 2026-10-31T00:04:11.674799Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T00:04:11.713365Z info cache generated new workload certificate resourceName=default latency=39.918866ms ttl=23h59m59.286638701s 2026-10-31T00:04:11.713437Z info cache Root cert has changed, start rotating root cert 2026-10-31T00:04:11.713475Z info cache returned workload trust anchor from cache ttl=23h59m59.286525618s 2026-10-31T00:04:11.746105Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T00:04:11.870714Z info ads ADS: new connection for node:1 2026-10-31T00:04:11.870793Z info cache returned workload certificate from cache ttl=23h59m59.129208128s 2026-10-31T00:04:11.871629Z info ads ADS: new connection for node:2 2026-10-31T00:04:11.871697Z info cache returned workload trust anchor from cache ttl=23h59m59.128304244s 2026-10-31T00:04:11.951698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:04:19.954012Z info Readiness succeeded in 8.289835261s 2026-10-31T00:04:19.954403Z info Envoy proxy is ready 2026-10-31T00:04:50.599164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:04:54.268Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 84 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "e592015b-e673-4be6-acec-d054cae0a8f3" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:44292 10.133.0.209:443 10.132.0.10:60280 - v1-completions-path 2026-10-31T00:05:06.244059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:09.020033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:13.128039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:05:13.128086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:05:13.128105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:05:13.128112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:05:13.044Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 83 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "ac0a597f-ccfb-48ab-9c4d-c236e5fd1838" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.209:54922 10.133.0.209:443 10.132.0.10:40298 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:05:25.219489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:27.071817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:29.709063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:38.112514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:05:46.781Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "958cfded-58d5-4846-aa18-ca113f476c8c" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:44292 10.133.0.209:443 10.132.0.10:38798 - v1-completions-path 2026-10-31T00:05:47.645579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T00:05:47.589Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 59 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "d37a9179-3cad-4bf5-9127-7419b9c8ec60" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:44292 10.133.0.209:443 10.132.0.10:52796 - v1-completions-path 2026-10-31T00:06:02.458258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:12.781257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:14.596406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:33.736630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:35.457869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:51.902333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:54.162446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:10.580314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:12.307212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:28.490353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:39.230107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:41.864940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:07:59.532Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 45 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "1bbd286e-075a-4111-a4c4-49550cae7392" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.209:443 10.132.0.10:58480 - v1-completions-path 2026-10-31T00:08:07.880509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:26.225627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:36.499107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:53.129938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:56.231990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:11:54.583918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:09.548967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:11.322000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:17.059986Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T00:12:17.060013Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T00:12:17.060016Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T00:12:17.060020Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T00:12:16.713Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 76 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "827b8e7d-fd3b-4297-9974-972b48fe20a3" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:42338 10.133.0.209:443 10.132.0.10:56274 - v1-completions-path [2026-10-31T00:12:17.024Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 35 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "935b8f79-1033-4d47-a47b-ea57ce95f2f4" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.209:443 10.132.0.10:42760 - v1-completions-path 2026-10-31T00:12:28.578446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:13:56.099769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:12.572424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:28.501659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:40.440044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:43.614398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:52.345631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:54.793001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:15:13.103984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:02.641218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:07.762157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:22.809046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:24.386003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:27.091053Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-31T00:18:26.997Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 93 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "74efd07c-d670-4e69-8bd5-274b91b5cb90" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:58102 10.133.0.209:443 10.132.0.10:47638 - v1-catch-all-path 2026-10-31T00:18:38.668412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:49.619757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8