2026-11-04T03:57:42.878507Z	info	FLAG: --concurrency="0"
2026-11-04T03:57:42.878523Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-11-04T03:57:42.878527Z	info	FLAG: --help="false"
2026-11-04T03:57:42.878530Z	info	FLAG: --log_as_json="false"
2026-11-04T03:57:42.878532Z	info	FLAG: --log_caller=""
2026-11-04T03:57:42.878534Z	info	FLAG: --log_output_level="default:info"
2026-11-04T03:57:42.878536Z	info	FLAG: --log_stacktrace_level="default:none"
2026-11-04T03:57:42.878541Z	info	FLAG: --log_target="[stdout]"
2026-11-04T03:57:42.878543Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-11-04T03:57:42.878545Z	info	FLAG: --outlierLogPath=""
2026-11-04T03:57:42.878547Z	info	FLAG: --profiling="true"
2026-11-04T03:57:42.878549Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-11-04T03:57:42.878551Z	info	FLAG: --proxyLogLevel="warning"
2026-11-04T03:57:42.878554Z	info	FLAG: --serviceCluster="istio-proxy"
2026-11-04T03:57:42.878557Z	info	FLAG: --stsPort="0"
2026-11-04T03:57:42.878559Z	info	FLAG: --templateFile=""
2026-11-04T03:57:42.878561Z	info	FLAG: --tokenManagerPlugin=""
2026-11-04T03:57:42.878563Z	info	FLAG: --vklog="0"
2026-11-04T03:57:42.878566Z	info	Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean
2026-11-04T03:57:42.878732Z	info	Proxy role	ips=[10.133.0.40] type=router id=maas-default-gateway-openshift-default-7d64fcddb7-gnswf.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-11-04T03:57:42.878795Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-11-04T03:57:42.880119Z	info	cpu limit detected as 2, setting concurrency
2026-11-04T03:57:42.880335Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-11-04T03:57:42.880346Z	info	JWT policy is third-party-jwt
2026-11-04T03:57:42.880349Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-11-04T03:57:42.882614Z	info	Starting default Istio SDS Server
2026-11-04T03:57:42.882645Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-11-04T03:57:42.882679Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-11-04T03:57:42.883222Z	info	Opening status port 15020
2026-11-04T03:57:42.884012Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-11-04T03:57:42.884928Z	info	sds	Starting SDS grpc server
2026-11-04T03:57:42.884948Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-11-04T03:57:42.885942Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-11-04T03:57:42.887175Z	info	Starting proxy agent
2026-11-04T03:57:42.887216Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-11-04T03:57:42.941851Z	info	cache	generated new workload certificate	resourceName=default latency=56.761361ms ttl=23h59m59.058154581s
2026-11-04T03:57:42.941962Z	info	cache	Root cert has changed, start rotating root cert
2026-11-04T03:57:42.942040Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.057960964s
2026-11-04T03:57:42.956865Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-11-04T03:57:43.113133Z	info	ads	ADS: new connection for node:1
2026-11-04T03:57:43.113210Z	info	cache	returned workload certificate from cache	ttl=23h59m58.886791816s
2026-11-04T03:57:43.113485Z	info	ads	ADS: new connection for node:2
2026-11-04T03:57:43.113562Z	info	cache	returned workload trust anchor from cache	ttl=23h59m58.886439994s
2026-11-04T03:57:43.205340Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-04T03:57:51.657028Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-04T03:57:52.588105Z	warn	Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2026-11-04T03:57:53.508957Z	warn	Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2026-11-04T03:57:54.520300Z	info	Readiness succeeded in 11.64493431s
2026-11-04T03:57:54.520622Z	info	Envoy proxy is ready
2026-11-04T03:57:54.522345Z	info	Readiness succeeded in 11.64698699s
[2026-11-04T03:58:19.130Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 72 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "ced42ae9-9100-4daf-ac1c-bd5156dd01d1" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 10.132.0.9:36828 - v1-model-routing
2026-11-04T04:00:09.597789Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-04T04:00:09.597827Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-04T04:00:09.597850Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-11-04T04:00:09.597855Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
[2026-11-04T04:00:09.519Z] "DELETE /v1/api-keys/adfa7c83-484d-4767-9a6e-15b40a84f239 HTTP/1.1" 200 - via_upstream - "-" 0 321 78 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "3af6f671-71fe-4e00-8761-66a301dff649" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:58244 10.133.0.40:443 10.132.0.9:47056 - odh-ai-gateway-infra.maas-api-route.3
2026-11-04T04:00:11.206737Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-04T04:00:11.206803Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-04T04:00:11.206816Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-11-04T04:00:11.206821Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
[2026-11-04T04:00:10.926Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 45 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "dc813b83-f206-4aff-afbf-e26469c8670f" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.40:443 10.132.0.9:47062 - odh-ai-gateway-infra.maas-api-route.3
[2026-11-04T04:00:11.148Z] "DELETE /v1/api-keys/02ac539a-1b9b-4abc-a367-10cbe5d864e9 HTTP/1.1" 200 - via_upstream - "-" 0 321 58 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "d98aa84f-3aaf-499a-9d86-794d71a5aaff" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:58244 10.133.0.40:443 10.132.0.9:47064 - odh-ai-gateway-infra.maas-api-route.3
[2026-11-04T04:00:20.082Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 90 - "44.212.242.249,10.132.0.9" "-" "bf53f241-a09e-48d3-acfa-4518dd92786b" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:42134 10.133.0.40:443 10.132.0.9:41360 - v1-completions-path
[2026-11-04T04:00:26.329Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 84 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "bf140b47-186b-40b2-aeef-08f6359d7ff2" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:42134 10.133.0.40:443 10.132.0.9:46948 - v1-completions-path
2026-11-04T04:00:40.666861Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-04T04:00:40.667005Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-04T04:00:40.667055Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=26
2026-11-04T04:00:40.667082Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
[2026-11-04T04:00:40.520Z] "DELETE /v1/api-keys/70e872e9-e380-4970-be5a-f23c16fcd94f HTTP/1.1" 200 - via_upstream - "-" 0 370 146 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5a3d65ac-86e7-4a24-a282-d17e16e4e253" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:42760 10.133.0.40:443 10.132.0.9:51792 - odh-ai-gateway-infra.maas-api-route.3
2026-11-04T04:00:51.182154Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=26
2026-11-04T04:00:51.182225Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-04T04:00:51.182250Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-04T04:00:51.182270Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-04T04:00:51.182280Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=26
[2026-11-04T04:00:51.093Z] "DELETE /v1/api-keys/70f96a14-671b-4319-bdfe-d44239e7beb0 HTTP/1.1" 200 - via_upstream - "-" 0 321 88 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "f32ac414-14f4-4871-8d9d-7509a6fdbf9a" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:42760 10.133.0.40:443 10.132.0.9:51830 - odh-ai-gateway-infra.maas-api-route.3