2026-11-02T18:55:08.941693Z	info	FLAG: --concurrency="0"
2026-11-02T18:55:08.941714Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-11-02T18:55:08.941719Z	info	FLAG: --help="false"
2026-11-02T18:55:08.941721Z	info	FLAG: --log_as_json="false"
2026-11-02T18:55:08.941723Z	info	FLAG: --log_caller=""
2026-11-02T18:55:08.941725Z	info	FLAG: --log_output_level="default:info"
2026-11-02T18:55:08.941727Z	info	FLAG: --log_stacktrace_level="default:none"
2026-11-02T18:55:08.941794Z	info	FLAG: --log_target="[stdout]"
2026-11-02T18:55:08.941797Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-11-02T18:55:08.941799Z	info	FLAG: --outlierLogPath=""
2026-11-02T18:55:08.941801Z	info	FLAG: --profiling="true"
2026-11-02T18:55:08.941803Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-11-02T18:55:08.941805Z	info	FLAG: --proxyLogLevel="warning"
2026-11-02T18:55:08.941807Z	info	FLAG: --serviceCluster="istio-proxy"
2026-11-02T18:55:08.941810Z	info	FLAG: --stsPort="0"
2026-11-02T18:55:08.941812Z	info	FLAG: --templateFile=""
2026-11-02T18:55:08.941814Z	info	FLAG: --tokenManagerPlugin=""
2026-11-02T18:55:08.941816Z	info	FLAG: --vklog="0"
2026-11-02T18:55:08.941819Z	info	Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean
2026-11-02T18:55:08.941977Z	info	Proxy role	ips=[10.134.1.74] type=router id=maas-default-gateway-openshift-default-9dccdc9b7-4qpb8.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-11-02T18:55:08.942035Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-11-02T18:55:08.943177Z	info	cpu limit detected as 2, setting concurrency
2026-11-02T18:55:08.943376Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-11-02T18:55:08.943388Z	info	JWT policy is third-party-jwt
2026-11-02T18:55:08.943391Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-11-02T18:55:08.944697Z	info	Starting default Istio SDS Server
2026-11-02T18:55:08.944720Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-11-02T18:55:08.944841Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-11-02T18:55:08.945354Z	info	Opening status port 15020
2026-11-02T18:55:08.946120Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-11-02T18:55:08.946823Z	info	sds	Starting SDS grpc server
2026-11-02T18:55:08.946843Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-11-02T18:55:08.947640Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-11-02T18:55:08.948626Z	info	Starting proxy agent
2026-11-02T18:55:08.948657Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-11-02T18:55:09.011316Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-11-02T18:55:09.020119Z	info	cache	generated new workload certificate	resourceName=default latency=73.192887ms ttl=23h59m59.979884416s
2026-11-02T18:55:09.020152Z	info	cache	Root cert has changed, start rotating root cert
2026-11-02T18:55:09.020184Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.979816098s
2026-11-02T18:55:09.163069Z	info	ads	ADS: new connection for node:1
2026-11-02T18:55:09.163300Z	info	cache	returned workload certificate from cache	ttl=23h59m59.836712041s
2026-11-02T18:55:09.163969Z	info	ads	ADS: new connection for node:2
2026-11-02T18:55:09.164522Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.835480269s
2026-11-02T18:55:09.247283Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:55:17.437251Z	info	Readiness succeeded in 8.498338462s
2026-11-02T18:55:17.437590Z	info	Envoy proxy is ready
2026-11-02T18:55:29.116887Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:55:48.130216Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:55:52.739043Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:56:02.448433Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T18:56:08.286Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 -  - "-" 61 18 71 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "2186f2ef-c63c-4a93-9dc6-234cc77c4e2f" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.74:443 10.132.0.19:59114 - v1-catch-all-path
2026-11-02T18:56:15.572793Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:56:24.751760Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:56:41.467887Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:56:53.366210Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:56:56.212132Z	info	ads	ADS: new connection for node:3
2026-11-02T18:56:56.212568Z	info	cache	adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-11-02T18:56:56.212660Z	info	cache	read certificate from file	resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-11-02T18:57:00.005940Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:57:39.792576Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T18:57:43.954Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 336 93 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "6a3dbdb6-f6b0-4850-8782-39ac0d896600" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.132.0.208:8000" outbound|54321||e2e-prio-pool-4397aa02-inference-pool-ip-f85414f8.llm.svc.cluster.local 10.134.1.74:59964 10.134.1.74:443 10.132.0.19:39198 - v1-model-routing
2026-11-02T18:58:04.155457Z	info	ads	ADS: "" 3 terminated
2026-11-02T18:58:04.206652Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:58:08.803989Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:58:08.804037Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:58:08.804056Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:58:08.804064Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-11-02T18:58:08.678Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 332 125 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "3b89b3d0-8562-41a4-a103-b68a7c38723e" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.132.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.74:60418 10.134.1.74:443 10.132.0.19:45876 - odh-ai-gateway-infra.maas-api-route.3
2026-11-02T18:58:09.070268Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:58:25.538648Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:00:58.631585Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:01:26.410690Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:01:52.755207Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:02:07.680628Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:02:14.222662Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:02:26.016447Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:02:30.803221Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:02:33.810505Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:02:33.810543Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:02:33.810558Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=26
2026-11-02T19:02:33.810563Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
[2026-11-02T19:02:33.687Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 122 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "8d325b4e-9261-401f-816d-6e868cc7b2d0" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.132.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.74:36184 10.134.1.74:443 10.132.0.19:47730 - odh-ai-gateway-infra.maas-api-route.3
2026-11-02T19:02:49.146119Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T19:02:52.406Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 77 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "ae42fedd-7d8f-47cd-b64e-a49ad8edc483" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.74:38198 10.134.1.74:443 10.132.0.19:42742 - v1-completions-path
2026-11-02T19:03:37.629685Z	info	ads	ADS: new connection for node:4
2026-11-02T19:03:37.635416Z	info	cache	adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt
2026-11-02T19:03:37.635477Z	info	cache	read certificate from file	resource=file-root:system
2026-11-02T19:03:41.541323Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:03:42.671205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:03:54.902708Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=26
2026-11-02T19:03:54.970860Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:03:54.970897Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:03:54.970911Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=26
2026-11-02T19:03:54.970916Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:03:54.971118Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=26
[2026-11-02T19:03:54.843Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1704 127 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "7544ee04-3a16-4d4d-832a-28ed3349f4ec" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.74:40350 10.134.1.74:443 10.132.0.19:60004 - models-as-a-service.external-model-e2e-rotation-external-model.0
2026-11-02T19:04:08.983707Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:04:08.983768Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:04:08.983778Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:04:08.983782Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=26
2026-11-02T19:04:08.983957Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=26
[2026-11-02T19:04:08.879Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1709 104 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "b356c2e3-d6b7-4c82-b0a7-a67abe20f4cb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.74:40350 10.134.1.74:443 10.132.0.19:60506 - models-as-a-service.external-model-e2e-rotation-external-model.0
2026-11-02T19:04:11.298725Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T19:04:11.298800Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T19:04:11.298815Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-11-02T19:04:11.298822Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T19:04:11.299024Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-11-02T19:04:11.183Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 116 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "83548bd4-a14c-4d47-9b49-e42d32dc7add" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.74:37144 10.134.1.74:443 10.132.0.19:60526 - models-as-a-service.external-model-e2e-rotation-external-model.0
2026-11-02T19:04:34.450556Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T19:04:34.450583Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T19:04:34.450592Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T19:04:34.450596Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-11-02T19:04:34.450793Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-11-02T19:04:34.336Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 114 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "fe8739ac-1c38-46fd-ab11-ac92957a622e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.74:37144 10.134.1.74:443 10.132.0.19:39492 - models-as-a-service.external-model-e2e-rotation-external-model.0
2026-11-02T19:05:13.527458Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:05:13.527501Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:05:13.527518Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=26
2026-11-02T19:05:13.527523Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=26
[2026-11-02T19:05:13.413Z] "DELETE /v1/api-keys/9ca6f619-633f-4728-99ff-ddec5c092b6d HTTP/1.1" 200 - via_upstream - "-" 0 359 114 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "50c6ee26-ffe9-4629-a426-8b15d598a87b" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.132.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.74:60794 10.134.1.74:443 10.132.0.19:51304 - odh-ai-gateway-infra.maas-api-route.3
2026-11-02T19:05:26.846399Z	info	ads	ADS: "" 4 terminated with stream closed
2026-11-02T19:05:26.890661Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:05:27.432255Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-11-02T19:05:27.432281Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-11-02T19:05:27.432284Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-11-02T19:05:27.432288Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'model' missing from lines 1-1 key: model	thread=25
[2026-11-02T19:05:27.394Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 -  - "-" 74 77 37 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "11dffd83-3cd8-4b64-a4b0-622a87d5b246" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.74:443 10.132.0.19:46296 - v1-completions-path
2026-11-02T19:05:29.413773Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:05:39.925098Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:05:58.255750Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:06:02.695728Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T19:06:06.451Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 73 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "15351298-b259-4def-b19b-9563530fe9b0" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.74:44028 10.134.1.74:443 10.132.0.19:47606 - v1-completions-path
[2026-11-02T19:06:21.477Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 65 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "f90f60c2-55bb-4ad9-adfb-c7c1438e5d6f" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.74:38198 10.134.1.74:443 10.132.0.19:47514 - v1-completions-path
2026-11-02T19:06:26.497799Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:06:39.862932Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:06:47.052303Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
[2026-11-02T19:06:46.995Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "6284ce5e-cc03-4fb2-a851-c0015ab9b79a" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.74:53678 10.134.1.74:443 10.132.0.19:35944 - v1-completions-path
2026-11-02T19:07:10.768194Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:07:21.552912Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:07:27.700706Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T19:07:39.737Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "7c5b6fe1-881c-49e6-a6b6-81ec175365d4" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.74:53678 10.134.1.74:443 10.132.0.19:51958 - v1-completions-path
[2026-11-02T19:07:42.386Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "fa65f1e0-a6f9-47ce-b5f3-57d5fe26b03f" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.74:44028 10.134.1.74:443 10.132.0.19:51980 - v1-completions-path
2026-11-02T19:07:56.287549Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:08:00.939046Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:08:14.046919Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:08:23.859379Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:08:33.047014Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:08:41.983816Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:08:49.557051Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:09:09.674868Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:09:15.671504Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:09:33.972376Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:09:39.372680Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T19:09:41.270Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 35 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "10aae190-3196-4335-89da-5fa3a9f95872" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.74:443 10.132.0.19:41966 - v1-completions-path
2026-11-02T19:09:50.597535Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:10:17.702088Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:10:28.402320Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:10:49.479577Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:10:55.490332Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:13:47.287678Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:15:17.031659Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:15:36.658773Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:15:41.694619Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:15:54.709958Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:16:11.166850Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:16:16.077986Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:16:21.968328Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T19:16:21.968367Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T19:16:21.968384Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-11-02T19:16:21.968389Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
[2026-11-02T19:16:21.854Z] "DELETE /v1/api-keys/512eed35-ff6f-4f23-85f4-9eb13f904ff5 HTTP/1.1" 200 - via_upstream - "-" 0 369 113 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "2f970c68-699e-4009-9cd1-7a68d2ac33b2" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.132.0.225:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.74:43584 10.134.1.74:443 10.132.0.19:40088 - odh-ai-gateway-infra.maas-api-route.3
2026-11-02T19:16:35.879485Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:16:46.470771Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:16:52.674400Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:17:19.945083Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:17:26.196866Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:17:32.253725Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:18:04.811716Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:18:15.618025Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:18:22.383686Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:18:28.373654Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:18:37.649217Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:19:00.625129Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:19:11.321302Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:19:16.103501Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:19:34.519183Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:19:40.572241Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:20:04.496647Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:20:26.318189Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:20:46.427375Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:20:57.085925Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:21:07.860292Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:21:18.638391Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:21:29.319407Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:21:40.173969Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:21:50.907472Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T19:22:01.583625Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T19:22:07.389Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 192 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "920113aa-37fd-4f82-bc33-c533b290f3fa" "maas.apps.ee7d99a15883b5bfd98c.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.74:38198 10.134.1.74:443 10.132.0.19:46758 - v1-completions-path