2026-10-29T23:23:42.474074Z	info	FLAG: --concurrency="0"
2026-10-29T23:23:42.474099Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-10-29T23:23:42.474103Z	info	FLAG: --help="false"
2026-10-29T23:23:42.474105Z	info	FLAG: --log_as_json="false"
2026-10-29T23:23:42.474107Z	info	FLAG: --log_caller=""
2026-10-29T23:23:42.474110Z	info	FLAG: --log_output_level="default:info"
2026-10-29T23:23:42.474112Z	info	FLAG: --log_stacktrace_level="default:none"
2026-10-29T23:23:42.474116Z	info	FLAG: --log_target="[stdout]"
2026-10-29T23:23:42.474118Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-10-29T23:23:42.474120Z	info	FLAG: --outlierLogPath=""
2026-10-29T23:23:42.474122Z	info	FLAG: --profiling="true"
2026-10-29T23:23:42.474124Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-10-29T23:23:42.474126Z	info	FLAG: --proxyLogLevel="warning"
2026-10-29T23:23:42.474128Z	info	FLAG: --serviceCluster="istio-proxy"
2026-10-29T23:23:42.474130Z	info	FLAG: --stsPort="0"
2026-10-29T23:23:42.474132Z	info	FLAG: --templateFile=""
2026-10-29T23:23:42.474134Z	info	FLAG: --tokenManagerPlugin=""
2026-10-29T23:23:42.474137Z	info	FLAG: --vklog="0"
2026-10-29T23:23:42.474139Z	info	Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean
2026-10-29T23:23:42.474269Z	info	Proxy role	ips=[10.132.0.42] type=router id=maas-default-gateway-openshift-default-746ff8f49f-wpwhs.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-10-29T23:23:42.474312Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-10-29T23:23:42.475319Z	info	cpu limit detected as 2, setting concurrency
2026-10-29T23:23:42.475510Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-10-29T23:23:42.475520Z	info	JWT policy is third-party-jwt
2026-10-29T23:23:42.475522Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-10-29T23:23:42.477213Z	info	Starting default Istio SDS Server
2026-10-29T23:23:42.477233Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-10-29T23:23:42.477257Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-10-29T23:23:42.477641Z	info	Opening status port 15020
2026-10-29T23:23:42.478350Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-10-29T23:23:42.479122Z	info	sds	Starting SDS grpc server
2026-10-29T23:23:42.479157Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-10-29T23:23:42.479616Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-10-29T23:23:42.480550Z	info	Starting proxy agent
2026-10-29T23:23:42.480591Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-10-29T23:23:42.538639Z	info	cache	generated new workload certificate	resourceName=default latency=59.411738ms ttl=23h59m59.461362636s
2026-10-29T23:23:42.538671Z	info	cache	Root cert has changed, start rotating root cert
2026-10-29T23:23:42.538705Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.46129544s
2026-10-29T23:23:42.542688Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-10-29T23:23:42.655519Z	info	ads	ADS: new connection for node:1
2026-10-29T23:23:42.655570Z	info	cache	returned workload certificate from cache	ttl=23h59m59.344430735s
2026-10-29T23:23:42.655907Z	info	ads	ADS: new connection for node:2
2026-10-29T23:23:42.655970Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.344030812s
2026-10-29T23:23:42.735747Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:23:50.592538Z	info	Readiness succeeded in 8.12071768s
2026-10-29T23:23:50.592855Z	info	Envoy proxy is ready
[2026-10-29T23:24:06.215Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 525 82 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "186b4a86-be9a-42ad-aee2-7f732fb7e5a7" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:34412 10.132.0.42:443 10.132.0.9:41532 - v1-model-routing
[2026-10-29T23:24:06.329Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 54 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "67b957fa-9289-40cb-8249-9e4c54f35f44" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.9:41544 - v1-model-routing
[2026-10-29T23:24:06.973Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 51 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "d08f8bad-8a49-4b05-9eb6-3e7001e67528" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.9:41558 - v1-model-routing
2026-10-29T23:26:21.129576Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:21.129609Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:21.129623Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:21.129628Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-29T23:26:21.039Z] "DELETE /v1/api-keys/5236bc5c-7df3-43b9-8490-94acfb1d2bf8 HTTP/1.1" 200 - via_upstream - "-" 0 321 89 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "212abd70-f718-4c35-a683-107805acab92" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:45086 10.132.0.42:443 10.132.0.9:45772 - odh-ai-gateway-infra.maas-api-route.3
[2026-10-29T23:26:21.587Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 70 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "af273e47-0795-4a22-bbe2-02ecd9a408bd" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.42:443 10.132.0.9:45788 - odh-ai-gateway-infra.maas-api-route.3
[2026-10-29T23:26:22.475Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 56 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "63b1822d-efd9-4b25-a0f0-7d9cc5f7c61e" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.42:443 10.132.0.9:45802 - odh-ai-gateway-infra.maas-api-route.3
2026-10-29T23:26:22.623789Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:22.623822Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:22.623835Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:22.623840Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-29T23:26:22.549Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 74 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "464f1cc5-c60a-4493-b5a9-99f575d05f87" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:45086 10.132.0.42:443 10.132.0.9:45806 - odh-ai-gateway-infra.maas-api-route.3
2026-10-29T23:26:30.597748Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:30.597779Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:30.597790Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:30.597796Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-29T23:26:30.546Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 7 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "8263fad0-86ca-490d-adfb-54b1df44b384" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.42:443 10.132.0.9:57652 - -
[2026-10-29T23:26:30.589Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 7 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "0e5f85c9-155e-4354-b64d-c203e2b91fe9" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:45086 10.132.0.42:443 10.132.0.9:57656 - odh-ai-gateway-infra.maas-api-route.4
2026-10-29T23:26:30.878021Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-29T23:26:30.878058Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-29T23:26:30.878074Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-29T23:26:30.878080Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-10-29T23:26:31.090098Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
[2026-10-29T23:26:30.810Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 606 67 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "5948062f-c628-4c14-9290-50f7d25a0cf5" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:53604 10.132.0.42:443 10.132.0.9:57670 - odh-ai-gateway-infra.maas-api-route.3
[2026-10-29T23:26:31.011Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 79 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "295c2205-e49d-4049-949c-1ce736e746b2" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:37126 10.132.0.42:443 10.132.0.9:57692 - v1-completions-path
2026-10-29T23:26:37.026983Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:26:40.393004Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-10-29T23:26:40.393027Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-10-29T23:26:40.393031Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-10-29T23:26:40.393035Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'model' missing from lines 1-1 key: model	thread=25
[2026-10-29T23:26:40.350Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 77 42 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "d9bf43eb-6dde-4b83-8b0f-7ce2c80878d5" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.9:54920 - v1-completions-path
2026-10-29T23:26:41.703494Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:41.703532Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:41.703546Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:26:41.703551Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-29T23:26:41.592Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 110 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "6834f52d-ed4b-477c-b579-c1a1327accf2" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:45086 10.132.0.42:443 10.132.0.9:54942 - odh-ai-gateway-infra.maas-api-route.3
[2026-10-29T23:26:42.042Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 103 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "9a93ad7f-4084-4fca-bc08-97a62c4dfe86" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:34412 10.132.0.42:443 10.132.0.9:54950 - v1-completions-path
[2026-10-29T23:26:42.164Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 107 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "083a1f90-c0f3-4869-aad9-41c97daefd8d" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:37126 10.132.0.42:443 10.132.0.9:54966 - v1-completions-path
2026-10-29T23:26:53.464387Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:32:15.749064Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:32:40.371541Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:33:21.868815Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:33:39.117633Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:33:43.259147Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:34:00.106380Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:34:15.664855Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:34:20.948230Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:34:20.948264Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:34:20.948278Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:34:20.948283Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-29T23:34:20.870Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 78 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "a1b7d811-7e8e-4d43-aae7-1babfab6a9b6" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:42604 10.132.0.42:443 10.132.0.9:46242 - odh-ai-gateway-infra.maas-api-route.3
2026-10-29T23:34:22.773297Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
[2026-10-29T23:34:22.320Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "c2bf2e1b-ee56-4daf-b842-5454bf1ad0fb" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:41644 10.132.0.42:443 10.132.0.9:46258 - v1-completions-path
[2026-10-29T23:34:22.722Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 53 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "9fe2ba31-27e8-494c-ab3c-0168db787d9e" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:41644 10.132.0.42:443 10.132.0.9:46274 - v1-completions-path
2026-10-29T23:34:23.459046Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
[2026-10-29T23:34:23.394Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "98b36040-9002-4127-98e3-add4941caab7" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:41652 10.132.0.42:443 10.132.0.9:46288 - v1-completions-path
2026-10-29T23:34:39.204969Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:34:49.535671Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:34:53.454158Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-29T23:34:58.145Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "95626a4d-3383-479b-a082-233da6875657" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:41652 10.132.0.42:443 10.132.0.9:39056 - v1-completions-path
[2026-10-29T23:34:58.394Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 54 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "fc4c1ae1-6547-4459-a66b-084e4272c645" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:41644 10.132.0.42:443 10.132.0.9:39058 - v1-completions-path
2026-10-29T23:35:11.078577Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:35:13.293342Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-29T23:35:20.680Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 296 74 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "bf3dd384-4923-4380-a29c-5c1237c377b6" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.27:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:45604 10.132.0.42:443 10.132.0.9:43370 - v1-completions-path
2026-10-29T23:35:32.646030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:35:37.158548Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:35:52.836179Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:35:54.841053Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:36:12.869695Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:36:23.747022Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:36:26.599312Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:36:48.135476Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-29T23:36:48.135512Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-29T23:36:48.135528Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-10-29T23:36:48.135533Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
[2026-10-29T23:36:47.910Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 32 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "05e91987-56f5-4e4f-8b9d-9f063d969d1c" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.9:43304 - v1-completions-path
[2026-10-29T23:36:48.062Z] "DELETE /v1/api-keys/8fa22113-c865-496a-9973-13bcb056735d HTTP/1.1" 200 - via_upstream - "-" 0 375 72 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "c63e02e6-862a-465b-91de-2b15be90fec3" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:50304 10.132.0.42:443 10.132.0.9:43318 - odh-ai-gateway-infra.maas-api-route.3
2026-10-29T23:40:04.405829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-10-29T23:40:06.798Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 287 153 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "c1d6f61a-e149-4dda-a0f2-0f9a213201a0" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.50:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:52126 10.132.0.42:443 10.132.0.9:33788 - v1-completions-path
2026-10-29T23:40:19.675282Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:40:21.721238Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:40:24.341846Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-29T23:40:24.341883Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-29T23:40:24.341897Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-10-29T23:40:24.341902Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-10-29T23:40:24.203Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 138 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "3b7a50ed-2068-48d1-ac92-968777dc87d7" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:58064 10.132.0.42:443 10.132.0.9:39354 - odh-ai-gateway-infra.maas-api-route.3
2026-10-29T23:40:36.442056Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:41:58.002929Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:42:19.936906Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:42:35.551028Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:42:49.731152Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:42:53.268075Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:43:05.300214Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:43:09.157137Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:43:13.559566Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:43:13.559604Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:43:13.559620Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-10-29T23:43:13.559625Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-10-29T23:43:13.506Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 525 53 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "cd076d8c-a716-423d-af7d-b77048c828af" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:33006 10.132.0.42:443 10.132.0.9:47260 - odh-ai-gateway-infra.maas-api-route.3
2026-10-29T23:43:25.663451Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:43:35.576945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:43:43.691252Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:43:59.049179Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:44:01.063041Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:44:15.831047Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-10-29T23:44:26.753488Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8