2026-10-30T21:01:42.042308Z	info	FLAG: --concurrency="0"
2026-10-30T21:01:42.042327Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-10-30T21:01:42.042331Z	info	FLAG: --help="false"
2026-10-30T21:01:42.042333Z	info	FLAG: --log_as_json="false"
2026-10-30T21:01:42.042335Z	info	FLAG: --log_caller=""
2026-10-30T21:01:42.042337Z	info	FLAG: --log_output_level="default:info"
2026-10-30T21:01:42.042339Z	info	FLAG: --log_stacktrace_level="default:none"
2026-10-30T21:01:42.042344Z	info	FLAG: --log_target="[stdout]"
2026-10-30T21:01:42.042346Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-10-30T21:01:42.042348Z	info	FLAG: --outlierLogPath=""
2026-10-30T21:01:42.042350Z	info	FLAG: --profiling="true"
2026-10-30T21:01:42.042352Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-10-30T21:01:42.042354Z	info	FLAG: --proxyLogLevel="warning"
2026-10-30T21:01:42.042355Z	info	FLAG: --serviceCluster="istio-proxy"
2026-10-30T21:01:42.042357Z	info	FLAG: --stsPort="0"
2026-10-30T21:01:42.042359Z	info	FLAG: --templateFile=""
2026-10-30T21:01:42.042361Z	info	FLAG: --tokenManagerPlugin=""
2026-10-30T21:01:42.042363Z	info	FLAG: --vklog="0"
2026-10-30T21:01:42.042366Z	info	Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean
2026-10-30T21:01:42.042496Z	info	Proxy role	ips=[10.132.0.196] type=router id=maas-default-gateway-openshift-default-58847f9fc5-xhg2f.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-10-30T21:01:42.042534Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-10-30T21:01:42.044024Z	info	cpu limit detected as 2, setting concurrency
2026-10-30T21:01:42.044225Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-10-30T21:01:42.044236Z	info	JWT policy is third-party-jwt
2026-10-30T21:01:42.044238Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-10-30T21:01:42.045567Z	info	Starting default Istio SDS Server
2026-10-30T21:01:42.045593Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-10-30T21:01:42.045617Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-10-30T21:01:42.046006Z	info	Opening status port 15020
2026-10-30T21:01:42.046889Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-10-30T21:01:42.047451Z	info	sds	Starting SDS grpc server
2026-10-30T21:01:42.047484Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-10-30T21:01:42.048261Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-10-30T21:01:42.049047Z	info	Starting proxy agent
2026-10-30T21:01:42.049080Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-10-30T21:01:42.115230Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-10-30T21:01:42.267392Z	info	ads	ADS: new connection for node:1
2026-10-30T21:01:42.268374Z	info	ads	ADS: new connection for node:2
2026-10-30T21:01:42.319058Z	info	cache	generated new workload certificate	resourceName=default latency=271.506228ms ttl=23h59m59.680946716s
2026-10-30T21:01:42.319094Z	info	cache	Root cert has changed, start rotating root cert
2026-10-30T21:01:42.319133Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.680867391s
2026-10-30T21:01:42.319155Z	info	cache	returned workload certificate from cache	ttl=23h59m59.680845614s
2026-10-30T21:01:42.319252Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.680751284s
2026-10-30T21:01:42.319561Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.68044028s
2026-10-30T21:01:42.412582Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:01:49.450138Z	error	failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused
2026-10-30T21:01:50.597174Z	info	Readiness succeeded in 8.557451409s
2026-10-30T21:01:50.597560Z	info	Envoy proxy is ready
2026-10-30T21:01:54.857164Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:02:41.034600Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T21:02:41.034650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T21:02:41.034665Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T21:02:41.034670Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-30T21:02:40.904Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 130 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "aa360931-3e91-4af5-b041-fdddb480090f" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.196:37810 10.132.0.196:443 10.132.0.11:55508 - odh-ai-gateway-infra.maas-api-route.3
2026-10-30T21:02:52.569425Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:03:15.775475Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:03:20.421585Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:03:32.414522Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T21:03:32.414571Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T21:03:32.414585Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T21:03:32.414590Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-10-30T21:03:32.297Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 117 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "010c74ef-c9ba-44d9-8d8a-97fbb7189dea" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.196:32916 10.132.0.196:443 10.132.0.11:43000 - odh-ai-gateway-infra.maas-api-route.3
2026-10-30T21:03:46.992382Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:04:04.170804Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:04:10.646661Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T21:04:10.646702Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T21:04:10.646720Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T21:04:10.646728Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-30T21:04:10.533Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 113 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "4a09a26a-b909-414a-9f3f-871e9cea0e41" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.196:57750 10.132.0.196:443 10.132.0.11:38700 - odh-ai-gateway-infra.maas-api-route.3
[2026-10-30T21:04:16.291Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 71 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "86a8a1ac-1b45-4c9a-b9e5-13d0cc9c5ac4" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.196:47990 10.132.0.196:443 10.132.0.11:57672 - v1-completions-path
2026-10-30T21:04:35.414597Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:04:45.950387Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:04:48.881799Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=2
2026-10-30T21:04:52.565624Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T21:05:08.189Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "9cc30e08-e1a8-4689-b65c-37c45dc57326" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.196:40680 10.132.0.196:443 10.132.0.11:60146 - v1-completions-path
2026-10-30T21:05:24.001188Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:05:28.586895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:05:52.172918Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:05:58.581042Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:06:24.872069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:06:47.014673Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:06:59.933700Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:07:06.255781Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:07:33.927750Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:07:39.628868Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T21:07:49.095Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 34 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "203b61b9-678d-4ddd-9ddc-8443143ee752" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.196:443 10.132.0.11:50770 - v1-completions-path
2026-10-30T21:07:57.644576Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:08:19.503079Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:08:30.388419Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:08:49.273666Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:08:55.380899Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:12:53.922021Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:13:10.962961Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:13:15.681795Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:13:40.033946Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:15:46.060857Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:16:30.624363Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:16:59.225230Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:17:15.050235Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:17:33.702705Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:17:46.209940Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:17:51.243228Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T21:18:04.265Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "77664f3e-ca6b-424a-88bc-52c6d7c1d57d" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.196:47990 10.132.0.196:443 10.132.0.11:35386 - v1-completions-path
[2026-10-30T21:18:04.830Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 55 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "3859e9f8-9dc4-4212-a38c-26b615955556" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.196:443 10.132.0.11:35398 - v1-completions-path
2026-10-30T21:18:19.036117Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:21:56.564359Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:22:15.580506Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:22:21.819952Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
2026-10-30T21:22:21.839317Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'completion_tokens' missing from lines 1-1 key: completion_tokens	thread=25
[2026-10-30T21:22:21.761Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 77 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "c16b2d8c-96f9-4383-b605-d50dd7b829f4" "maas.apps.974b47378d58536534f5.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.196:43270 10.132.0.196:443 10.132.0.11:38070 - v1-catch-all-path
2026-10-30T21:22:36.578191Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:22:41.198680Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:22:57.400439Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T21:23:09.113955Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8