2026-11-02T17:48:17.090894Z	info	FLAG: --concurrency="0"
2026-11-02T17:48:17.090911Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-11-02T17:48:17.090916Z	info	FLAG: --help="false"
2026-11-02T17:48:17.090918Z	info	FLAG: --log_as_json="false"
2026-11-02T17:48:17.090920Z	info	FLAG: --log_caller=""
2026-11-02T17:48:17.090922Z	info	FLAG: --log_output_level="default:info"
2026-11-02T17:48:17.090924Z	info	FLAG: --log_stacktrace_level="default:none"
2026-11-02T17:48:17.090929Z	info	FLAG: --log_target="[stdout]"
2026-11-02T17:48:17.090931Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-11-02T17:48:17.090933Z	info	FLAG: --outlierLogPath=""
2026-11-02T17:48:17.090935Z	info	FLAG: --profiling="true"
2026-11-02T17:48:17.090937Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-11-02T17:48:17.090939Z	info	FLAG: --proxyLogLevel="warning"
2026-11-02T17:48:17.090942Z	info	FLAG: --serviceCluster="istio-proxy"
2026-11-02T17:48:17.090944Z	info	FLAG: --stsPort="0"
2026-11-02T17:48:17.090946Z	info	FLAG: --templateFile=""
2026-11-02T17:48:17.090948Z	info	FLAG: --tokenManagerPlugin=""
2026-11-02T17:48:17.090950Z	info	FLAG: --vklog="0"
2026-11-02T17:48:17.090953Z	info	Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean
2026-11-02T17:48:17.091106Z	info	Proxy role	ips=[10.132.0.58] type=router id=maas-default-gateway-openshift-default-fcb75c45f-2m464.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-11-02T17:48:17.091154Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-11-02T17:48:17.092179Z	info	cpu limit detected as 2, setting concurrency
2026-11-02T17:48:17.092728Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-11-02T17:48:17.092739Z	info	JWT policy is third-party-jwt
2026-11-02T17:48:17.092742Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-11-02T17:48:17.093923Z	info	Starting default Istio SDS Server
2026-11-02T17:48:17.093942Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-11-02T17:48:17.093958Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-11-02T17:48:17.094321Z	info	Opening status port 15020
2026-11-02T17:48:17.095528Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-11-02T17:48:17.096917Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-11-02T17:48:17.097696Z	info	Starting proxy agent
2026-11-02T17:48:17.097725Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-11-02T17:48:17.107137Z	info	sds	Starting SDS grpc server
2026-11-02T17:48:17.107154Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-11-02T17:48:17.136069Z	info	cache	generated new workload certificate	resourceName=default latency=40.201797ms ttl=23h59m59.863933228s
2026-11-02T17:48:17.136096Z	info	cache	Root cert has changed, start rotating root cert
2026-11-02T17:48:17.136123Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.863877489s
2026-11-02T17:48:17.160224Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-11-02T17:48:17.264217Z	info	ads	ADS: new connection for node:1
2026-11-02T17:48:17.264542Z	info	cache	returned workload certificate from cache	ttl=23h59m59.735460481s
2026-11-02T17:48:17.264582Z	info	ads	ADS: new connection for node:2
2026-11-02T17:48:17.264878Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.735123673s
2026-11-02T17:48:17.343573Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T17:48:25.218706Z	info	Readiness succeeded in 8.130418462s
2026-11-02T17:48:25.219112Z	info	Envoy proxy is ready
[2026-11-02T17:48:45.570Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 444 85 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "bd41ec18-bbb4-4163-a068-5d3d879f4d5f" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:47500 10.132.0.58:443 10.132.0.11:44400 - v1-model-routing
[2026-11-02T17:48:51.584Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 56 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "aabdce07-fd01-4dc5-a52c-84987b61a512" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.58:443 10.132.0.11:44410 - v1-model-routing
[2026-11-02T17:48:51.945Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 53 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "af71eb12-9c07-496b-916e-c0fbc77fdf35" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.58:443 10.132.0.11:44426 - v1-model-routing
[2026-11-02T17:48:52.057Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 54 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "a9fc8cdc-8bc6-4a42-9cd9-6b7e387e257f" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.58:443 10.132.0.11:44438 - v1-model-routing
[2026-11-02T17:51:11.581Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 83 0 41 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "124933fa-b4b4-4c5d-9a76-1ca3b93703a2" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.58:443 10.132.0.11:59292 - odh-ai-gateway-infra.maas-api-route.3
[2026-11-02T17:51:12.977Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "61a68d31-8d15-4f51-821d-6a059d550867" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.58:443 10.132.0.11:59308 - odh-ai-gateway-infra.maas-api-route.3
[2026-11-02T17:51:14.443Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 38 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "d526d2c8-7bea-4f28-88eb-d4f97b70a781" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.58:443 10.132.0.11:44048 - odh-ai-gateway-infra.maas-api-route.3
2026-11-02T17:51:15.400030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-02T17:51:15.400081Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-02T17:51:15.400102Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-11-02T17:51:15.400109Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-02T17:51:15.890792Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T17:51:15.890868Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T17:51:15.890885Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-11-02T17:51:15.890890Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
[2026-11-02T17:51:15.294Z] "DELETE /v1/api-keys/726f2a94-44fc-4c14-95c7-8a77b188290e HTTP/1.1" 200 - via_upstream - "-" 0 321 105 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "c5e8286f-880d-4094-b651-4c47e6543528" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:34298 10.132.0.58:443 10.132.0.11:44060 - odh-ai-gateway-infra.maas-api-route.3
[2026-11-02T17:51:15.767Z] "DELETE /v1/api-keys/75bf737f-8eec-4efa-b77c-8ade339eb3f3 HTTP/1.1" 200 - via_upstream - "-" 0 321 123 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "13b80a9f-9e77-4e4f-b050-8b6edcd75ddb" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:34306 10.132.0.58:443 10.132.0.11:44062 - odh-ai-gateway-infra.maas-api-route.3
2026-11-02T17:51:23.722089Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T17:51:28.548Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 72 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "3be2fd99-4f33-49a5-9dd8-7009cb5d2e6f" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:47500 10.132.0.58:443 10.132.0.11:56078 - v1-completions-path
2026-11-02T17:51:36.039213Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T17:55:15.807497Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T17:55:24.033572Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-02T17:55:24.033607Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-02T17:55:24.033619Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=24
2026-11-02T17:55:24.033624Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-11-02T17:55:24.033790Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-11-02T17:55:24.033887Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=24
2026-11-02T17:55:24.033899Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=24
2026-11-02T17:55:24.033903Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=24
2026-11-02T17:55:24.033908Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'model' missing from lines 1-1 key: model	thread=24
[2026-11-02T17:55:23.928Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 105 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "2a7b2e65-1105-489e-bde5-1bb936cce6a6" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:47500 10.132.0.58:443 10.132.0.11:42836 - v1-completions-path
2026-11-02T17:55:49.972768Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T17:56:45.909374Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T17:57:26.868554Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:01:41.599693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:02:04.803693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:02:50.168534Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T18:02:55.833Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 74 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f97e420e-13ca-405d-84f2-005ef3c81792" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:34972 10.132.0.58:443 10.132.0.11:45350 - v1-completions-path
2026-11-02T18:03:08.322354Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:03:11.811210Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:03:29.296275Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:03:31.081218Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:03:34.120342Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:03:42.169235Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T18:03:48.555Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "2985c487-fd55-43b1-9ffc-74dd67644048" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:34972 10.132.0.58:443 10.132.0.11:55054 - v1-completions-path
2026-11-02T18:03:50.661308Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
[2026-11-02T18:03:50.210Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "e4df03e8-0a37-4729-a63e-5f4ccca9532a" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:33470 10.132.0.58:443 10.132.0.11:55058 - v1-completions-path
[2026-11-02T18:03:50.656Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "b5af9f1c-2e82-4a39-a7f6-03141112d3cc" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:33470 10.132.0.58:443 10.132.0.11:55078 - v1-completions-path
2026-11-02T18:04:06.460028Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:04:16.991470Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:04:28.604592Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T18:04:34.482Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f93de086-3416-485e-8700-6525643ffed2" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:33470 10.132.0.58:443 10.132.0.11:54158 - v1-completions-path
[2026-11-02T18:04:35.824Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f6dab6d0-510c-4a65-a6e6-c7ff7e1c67cd" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:34972 10.132.0.58:443 10.132.0.11:54170 - v1-completions-path
2026-11-02T18:04:47.787687Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:04:49.615030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:05:06.254555Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:05:08.593668Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:05:25.018208Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:05:26.892139Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T18:05:41.863Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 67 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "c5b2946a-b753-45f7-b8cd-681452397557" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:47500 10.132.0.58:443 10.132.0.11:34766 - v1-completions-path
2026-11-02T18:05:42.932753Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:05:53.511075Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:05:56.496306Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:06:15.164629Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:06:17.266506Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:06:20.936864Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
2026-11-02T18:06:20.942747Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:06:20.942784Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:06:20.942796Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-11-02T18:06:20.942801Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:06:21.065444Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:06:21.065484Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:06:21.065499Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-11-02T18:06:21.065504Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
[2026-11-02T18:06:20.882Z] "DELETE /v1/api-keys/0af39463-cf94-4276-be31-fae4f59a5902 HTTP/1.1" 404 - via_upstream - "-" 0 29 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "1de8230a-0bdb-462a-a31c-274349cc2843" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:52532 10.132.0.58:443 10.132.0.11:34802 - odh-ai-gateway-infra.maas-api-route.3
[2026-11-02T18:06:21.001Z] "DELETE /v1/api-keys/556c9ec2-0dee-4336-a90c-696e204470e4 HTTP/1.1" 200 - via_upstream - "-" 0 375 64 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9e292f5e-bcdc-45e5-9787-9727a28d3cae" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:52532 10.132.0.58:443 10.132.0.11:34808 - odh-ai-gateway-infra.maas-api-route.3
2026-11-02T18:06:24.686178Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:06:43.041438Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:06:53.048347Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:08:56.930376Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:08:59.571723Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:10:38.339666Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-11-02T18:10:41.336Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 287 87 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "1149109c-317d-426f-9255-b517f2e0ff40" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:53510 10.132.0.58:443 10.132.0.11:44972 - v1-completions-path
2026-11-02T18:10:53.605173Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:10:55.222417Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:11:00.977308Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-11-02T18:11:00.977339Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-11-02T18:11:00.977343Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372		thread=25
2026-11-02T18:11:00.977349Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'model' missing from lines 1-1 key: model	thread=25
[2026-11-02T18:11:00.938Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 123 39 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "940a23c3-8d24-4962-823b-4171f2fa50a5" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.58:443 10.132.0.11:44660 - v1-completions-path
2026-11-02T18:11:12.392886Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:12:41.359983Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:12:41.360020Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:12:41.360033Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model	thread=25
2026-11-02T18:12:41.360038Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-11-02T18:12:41.282Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 77 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "fb90594e-0d8c-48a6-9b60-4e45e7125acb" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:35508 10.132.0.58:443 10.132.0.11:50342 - odh-ai-gateway-infra.maas-api-route.3
2026-11-02T18:12:45.902137Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:13:02.014111Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:13:17.829352Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:13:29.261316Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:13:33.120716Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:13:44.298826Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:13:47.808147Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:14:04.850098Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:17:03.535818Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:17:06.975148Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'completion_tokens' missing from lines 1-1 key: completion_tokens	thread=25
[2026-11-02T18:17:06.896Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 78 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9143a1de-851e-4dab-bf0d-9ed72804da70" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:36952 10.132.0.58:443 10.132.0.11:44622 - v1-catch-all-path
2026-11-02T18:17:08.968139Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:17:12.392735Z	warning	envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385	key 'completion_tokens' missing from lines 1-1 key: completion_tokens	thread=25
[2026-11-02T18:17:12.332Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "194a0ee7-0cf8-4884-b3ce-f09643138b81" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:36952 10.132.0.58:443 10.132.0.11:44650 - v1-catch-all-path
2026-11-02T18:17:24.424746Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:17:26.022116Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:17:40.633643Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-11-02T18:17:51.397118Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8