2026-10-30T23:06:44.973825Z	info	FLAG: --concurrency="0"
2026-10-30T23:06:44.973846Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-10-30T23:06:44.973850Z	info	FLAG: --help="false"
2026-10-30T23:06:44.973852Z	info	FLAG: --log_as_json="false"
2026-10-30T23:06:44.973854Z	info	FLAG: --log_caller=""
2026-10-30T23:06:44.973856Z	info	FLAG: --log_output_level="default:info"
2026-10-30T23:06:44.973858Z	info	FLAG: --log_stacktrace_level="default:none"
2026-10-30T23:06:44.973863Z	info	FLAG: --log_target="[stdout]"
2026-10-30T23:06:44.973865Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-10-30T23:06:44.973867Z	info	FLAG: --outlierLogPath=""
2026-10-30T23:06:44.973869Z	info	FLAG: --profiling="true"
2026-10-30T23:06:44.973871Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-10-30T23:06:44.973873Z	info	FLAG: --proxyLogLevel="warning"
2026-10-30T23:06:44.973875Z	info	FLAG: --serviceCluster="istio-proxy"
2026-10-30T23:06:44.973877Z	info	FLAG: --stsPort="0"
2026-10-30T23:06:44.973879Z	info	FLAG: --templateFile=""
2026-10-30T23:06:44.973880Z	info	FLAG: --tokenManagerPlugin=""
2026-10-30T23:06:44.973883Z	info	FLAG: --vklog="0"
2026-10-30T23:06:44.973886Z	info	Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean
2026-10-30T23:06:44.974031Z	info	Proxy role	ips=[10.133.1.146] type=router id=maas-default-gateway-openshift-default-6db586dd6c-hcq62.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-10-30T23:06:44.974076Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-10-30T23:06:44.975099Z	info	cpu limit detected as 2, setting concurrency
2026-10-30T23:06:44.975331Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-10-30T23:06:44.975342Z	info	JWT policy is third-party-jwt
2026-10-30T23:06:44.975345Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-10-30T23:06:44.976630Z	info	Starting default Istio SDS Server
2026-10-30T23:06:44.976656Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-10-30T23:06:44.976674Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-10-30T23:06:44.977070Z	info	Opening status port 15020
2026-10-30T23:06:44.978263Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-10-30T23:06:44.978536Z	info	sds	Starting SDS grpc server
2026-10-30T23:06:44.978572Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-10-30T23:06:44.979604Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-10-30T23:06:44.980414Z	info	Starting proxy agent
2026-10-30T23:06:44.980446Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-10-30T23:06:45.044386Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-10-30T23:06:45.060018Z	info	cache	generated new workload certificate	resourceName=default latency=81.367345ms ttl=23h59m59.939986407s
2026-10-30T23:06:45.060049Z	info	cache	Root cert has changed, start rotating root cert
2026-10-30T23:06:45.060083Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.939917476s
2026-10-30T23:06:45.154689Z	info	ads	ADS: new connection for node:1
2026-10-30T23:06:45.154920Z	info	cache	returned workload certificate from cache	ttl=23h59m59.845082318s
2026-10-30T23:06:45.155194Z	info	ads	ADS: new connection for node:2
2026-10-30T23:06:45.155435Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.844567322s
2026-10-30T23:06:45.250790Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:06:53.097463Z	info	Readiness succeeded in 8.126548575s
2026-10-30T23:06:53.097854Z	info	Envoy proxy is ready
2026-10-30T23:07:20.737830Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=24
2026-10-30T23:07:20.737859Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=24
2026-10-30T23:07:20.737863Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=24
2026-10-30T23:07:20.737866Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'model' missing from lines 1-1 key: model	thread=24
[2026-10-30T23:07:20.693Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 -  - "-" 74 77 44 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "b0bc9ea2-d0f4-43ac-9c61-15ccc07e482c" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.146:443 10.132.0.10:45460 - v1-completions-path
2026-10-30T23:07:25.727570Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:07:29.773382Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T23:07:29.773422Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T23:07:29.773436Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T23:07:29.773440Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-10-30T23:07:29.684Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 88 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "4f35f1e8-7bf7-47fa-82e8-d27472c18b19" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.146:60698 10.133.1.146:443 10.132.0.10:39008 - odh-ai-gateway-infra.maas-api-route.3
[2026-10-30T23:07:30.003Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 74 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "bd1056ab-0a69-4035-847f-66e42275f108" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:38300 10.133.1.146:443 10.132.0.10:39018 - v1-completions-path
[2026-10-30T23:07:30.200Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "c86235f3-8e73-44bc-b780-588476ab853a" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:38316 10.133.1.146:443 10.132.0.10:39032 - v1-completions-path
2026-10-30T23:07:42.762915Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:07:48.202356Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T23:07:53.539Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 103 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "ba63afef-7905-4f79-bdd7-73bfbb80c802" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:38300 10.133.1.146:443 10.132.0.10:46902 - v1-completions-path
[2026-10-30T23:07:53.681Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 89 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "ebc6dcc5-caae-419f-ba5e-fe09cad94bfb" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:38316 10.133.1.146:443 10.132.0.10:46918 - v1-completions-path
2026-10-30T23:08:06.066432Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:08:21.871522Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:08:27.249049Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
[2026-10-30T23:08:27.191Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "b828d46e-3f19-450d-b98f-8bec29d8a801" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:38300 10.133.1.146:443 10.132.0.10:53930 - v1-completions-path
2026-10-30T23:08:45.121195Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:08:55.501636Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:09:00.274054Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T23:09:03.739Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 70 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "2eb595ba-7d21-4ba7-a6fa-83d37a3e7a04" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:38316 10.133.1.146:443 10.132.0.10:56730 - v1-completions-path
[2026-10-30T23:09:04.326Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 66 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "04b160b3-1cb3-4198-95c9-4485d480016c" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:38300 10.133.1.146:443 10.132.0.10:56740 - v1-completions-path
2026-10-30T23:09:05.042190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
[2026-10-30T23:09:04.990Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "eb162f35-b461-4c72-b18c-d8b2f75279a4" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:38316 10.133.1.146:443 10.132.0.10:56764 - v1-completions-path
2026-10-30T23:09:16.984687Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:09:19.444307Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:09:38.513122Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:09:43.076330Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:09:58.673759Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:10:01.045141Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:10:18.883502Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:10:29.541544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:10:32.841112Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T23:10:55.613Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 73 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "ee6076f6-eeae-42ca-8fd8-91c3c4dae19a" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.146:56612 10.133.1.146:443 10.132.0.10:58152 - v1-completions-path
2026-10-30T23:11:02.548635Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:11:20.559054Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:11:30.977031Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:15:01.011235Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:15:16.629514Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:15:19.049128Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:15:37.971730Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:17:12.584164Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:17:32.063472Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:17:47.614492Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:17:59.599604Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:18:04.613972Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:18:16.715702Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:18:20.473629Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:18:27.837553Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T23:18:27.837589Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T23:18:27.837604Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T23:18:27.837609Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-10-30T23:18:27.761Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 76 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "5ffb8c7f-66d4-4f89-b68f-36a30e6c274c" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.146:50190 10.133.1.146:443 10.132.0.10:50340 - odh-ai-gateway-infra.maas-api-route.3
2026-10-30T23:18:40.334045Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:21:30.961574Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:21:39.186423Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:21:57.035898Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:21:59.308364Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:22:14.222624Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:22:25.483387Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8