2026-10-30T22:42:57.336452Z	info	FLAG: --concurrency="0"
2026-10-30T22:42:57.336472Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-10-30T22:42:57.336477Z	info	FLAG: --help="false"
2026-10-30T22:42:57.336479Z	info	FLAG: --log_as_json="false"
2026-10-30T22:42:57.336481Z	info	FLAG: --log_caller=""
2026-10-30T22:42:57.336484Z	info	FLAG: --log_output_level="default:info"
2026-10-30T22:42:57.336486Z	info	FLAG: --log_stacktrace_level="default:none"
2026-10-30T22:42:57.336491Z	info	FLAG: --log_target="[stdout]"
2026-10-30T22:42:57.336493Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-10-30T22:42:57.336495Z	info	FLAG: --outlierLogPath=""
2026-10-30T22:42:57.336497Z	info	FLAG: --profiling="true"
2026-10-30T22:42:57.336500Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-10-30T22:42:57.336502Z	info	FLAG: --proxyLogLevel="warning"
2026-10-30T22:42:57.336504Z	info	FLAG: --serviceCluster="istio-proxy"
2026-10-30T22:42:57.336506Z	info	FLAG: --stsPort="0"
2026-10-30T22:42:57.336508Z	info	FLAG: --templateFile=""
2026-10-30T22:42:57.336510Z	info	FLAG: --tokenManagerPlugin=""
2026-10-30T22:42:57.336512Z	info	FLAG: --vklog="0"
2026-10-30T22:42:57.336515Z	info	Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean
2026-10-30T22:42:57.336671Z	info	Proxy role	ips=[10.132.0.195] type=router id=maas-default-gateway-openshift-default-85544d4cd7-jst4g.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-10-30T22:42:57.336717Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-10-30T22:42:57.338087Z	info	cpu limit detected as 2, setting concurrency
2026-10-30T22:42:57.338354Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-10-30T22:42:57.338367Z	info	JWT policy is third-party-jwt
2026-10-30T22:42:57.338370Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-10-30T22:42:57.339761Z	info	Starting default Istio SDS Server
2026-10-30T22:42:57.339791Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-10-30T22:42:57.339816Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-10-30T22:42:57.340345Z	info	Opening status port 15020
2026-10-30T22:42:57.341659Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-10-30T22:42:57.342125Z	info	sds	Starting SDS grpc server
2026-10-30T22:42:57.342168Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-10-30T22:42:57.342980Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-10-30T22:42:57.343820Z	info	Starting proxy agent
2026-10-30T22:42:57.343853Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-10-30T22:42:57.412635Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-10-30T22:42:57.496034Z	info	cache	generated new workload certificate	resourceName=default latency=153.76108ms ttl=23h59m59.503972432s
2026-10-30T22:42:57.496096Z	info	cache	Root cert has changed, start rotating root cert
2026-10-30T22:42:57.496153Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.503848639s
2026-10-30T22:42:57.580512Z	info	ads	ADS: new connection for node:1
2026-10-30T22:42:57.580586Z	info	cache	returned workload certificate from cache	ttl=23h59m59.419416659s
2026-10-30T22:42:57.580688Z	info	ads	ADS: new connection for node:2
2026-10-30T22:42:57.580795Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.419218243s
2026-10-30T22:42:57.670693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:43:05.776230Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:43:06.812502Z	warn	Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2026-10-30T22:43:07.764439Z	info	Readiness succeeded in 10.430876669s
2026-10-30T22:43:07.765178Z	info	Envoy proxy is ready
2026-10-30T22:43:25.833485Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:43:42.792595Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T22:43:50.104Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 91 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "2a8f54e6-763d-4ea9-9d0b-dbdfe1284de1" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.195:47862 10.132.0.195:443 10.132.0.19:39498 - v1-completions-path
[2026-10-30T22:43:54.897Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "ce72e264-d12e-4617-a7cd-a924420ee2d3" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.195:47862 10.132.0.195:443 10.132.0.19:50446 - v1-completions-path
2026-10-30T22:44:13.586866Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:44:24.165476Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:44:28.794385Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:44:59.129378Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:45:03.799928Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:45:13.551718Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T22:45:13.551759Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T22:45:13.551773Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-10-30T22:45:13.551778Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
[2026-10-30T22:45:13.354Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 197 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "e2d1d2e7-fc62-4199-b25d-f211dd8e173a" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.195:57448 10.132.0.195:443 10.132.0.19:39142 - odh-ai-gateway-infra.maas-api-route.3
2026-10-30T22:45:27.413919Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:45:33.607822Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:45:59.890461Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:46:22.101460Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:46:34.993934Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:46:40.952633Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:47:05.734728Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:47:11.066231Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:47:23.210664Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
[2026-10-30T22:47:23.204Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 0 34 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "fc2d520b-5d02-4e85-90eb-66092223f603" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.195:443 10.132.0.19:47532 - v1-completions-path
2026-10-30T22:47:31.273242Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:47:54.557487Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:48:05.211374Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:48:27.488431Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:48:33.303535Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:50:50.834520Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:50:56.863518Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:52:41.829277Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:52:45.492506Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T22:52:45.492542Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-30T22:52:45.492555Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-10-30T22:52:45.492560Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
[2026-10-30T22:52:45.376Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 115 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "e90b6dfb-b7fb-4a0c-8e36-93998fdce678" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.195:35118 10.132.0.195:443 10.132.0.19:50712 - odh-ai-gateway-infra.maas-api-route.3
2026-10-30T22:52:59.089128Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:53:03.521564Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T22:53:14.197Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 75 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "2aff2446-c935-4232-aa07-0e25e7ade193" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.195:42646 10.132.0.195:443 10.132.0.19:45304 - v1-completions-path
2026-10-30T22:53:28.293221Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:55:33.211857Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:56:15.230990Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:56:43.324332Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T22:56:43.324392Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T22:56:43.324419Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-30T22:56:43.324426Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-30T22:56:43.194Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 129 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "9ff6d204-7c32-4dc7-aba6-5615d5170ef8" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.195:35212 10.132.0.195:443 10.132.0.19:57684 - odh-ai-gateway-infra.maas-api-route.3
2026-10-30T22:56:46.257061Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:57:00.490030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:57:14.098379Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:57:26.315739Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:57:31.333850Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T22:57:58.664945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:01:46.101989Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:01:53.594176Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'completion_tokens' missing from lines 1-1 key: completion_tokens	thread=25
[2026-10-30T23:01:53.513Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 80 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "bfe4ba22-1045-414d-8a84-2ea9b9543cdc" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.195:43830 10.132.0.195:443 10.132.0.19:33400 - v1-catch-all-model-routing
2026-10-30T23:01:57.834425Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-30T23:02:05.189Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 -  - "-" 61 18 65 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "10f5e377-22ad-9f9a-8027-d89e89231820" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.195:443 10.132.0.19:33630 - v1-catch-all-path
2026-10-30T23:02:18.915302Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:02:23.432261Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:02:39.799626Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-30T23:02:51.415737Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8