2026-10-30T23:35:54.822287Z info FLAG: --concurrency="0" 2026-10-30T23:35:54.822307Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T23:35:54.822313Z info FLAG: --help="false" 2026-10-30T23:35:54.822316Z info FLAG: --log_as_json="false" 2026-10-30T23:35:54.822319Z info FLAG: --log_caller="" 2026-10-30T23:35:54.822322Z info FLAG: --log_output_level="default:info" 2026-10-30T23:35:54.822325Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T23:35:54.822331Z info FLAG: --log_target="[stdout]" 2026-10-30T23:35:54.822335Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T23:35:54.822337Z info FLAG: --outlierLogPath="" 2026-10-30T23:35:54.822340Z info FLAG: --profiling="true" 2026-10-30T23:35:54.822342Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T23:35:54.822345Z info FLAG: --proxyLogLevel="warning" 2026-10-30T23:35:54.822348Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T23:35:54.822351Z info FLAG: --stsPort="0" 2026-10-30T23:35:54.822354Z info FLAG: --templateFile="" 2026-10-30T23:35:54.822357Z info FLAG: --tokenManagerPlugin="" 2026-10-30T23:35:54.822360Z info FLAG: --vklog="0" 2026-10-30T23:35:54.822364Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T23:35:54.822514Z info Proxy role ips=[10.132.0.43] type=router id=maas-default-gateway-openshift-default-5df48fcc99-trpdx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T23:35:54.822562Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T23:35:54.823696Z info cpu limit detected as 2, setting concurrency 2026-10-30T23:35:54.823888Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T23:35:54.823899Z info JWT policy is third-party-jwt 2026-10-30T23:35:54.823901Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T23:35:54.825206Z info Starting default Istio SDS Server 2026-10-30T23:35:54.825226Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T23:35:54.825244Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T23:35:54.825797Z info Opening status port 15020 2026-10-30T23:35:54.826610Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T23:35:54.829228Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T23:35:54.831535Z info sds Starting SDS grpc server 2026-10-30T23:35:54.831959Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T23:35:54.833064Z info Starting proxy agent 2026-10-30T23:35:54.833137Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T23:35:54.900971Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T23:35:54.925922Z info cache generated new workload certificate resourceName=default latency=99.781262ms ttl=23h59m59.074081318s 2026-10-30T23:35:54.925961Z info cache Root cert has changed, start rotating root cert 2026-10-30T23:35:54.925991Z info cache returned workload trust anchor from cache ttl=23h59m59.074010073s 2026-10-30T23:35:55.001202Z info ads ADS: new connection for node:1 2026-10-30T23:35:55.001267Z info cache returned workload certificate from cache ttl=23h59m58.998734578s 2026-10-30T23:35:55.001307Z info ads ADS: new connection for node:2 2026-10-30T23:35:55.001376Z info cache returned workload trust anchor from cache ttl=23h59m58.998625395s 2026-10-30T23:35:55.044752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:36:01.444089Z info Readiness succeeded in 6.62433306s 2026-10-30T23:36:01.444357Z info Envoy proxy is ready 2026-10-30T23:36:02.546197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:36:03.713880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:36:06.379740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:36:09.113812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:36:13.364507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:36:17.249216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:36:33.466994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:36:34.034656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:37:08.161794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T23:37:08.161832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T23:37:08.161847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T23:37:08.161852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T23:37:08.080Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 81 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "3842f089-83be-4b6b-a74f-16a2e9439be1" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:33168 10.132.0.43:443 10.132.0.10:40060 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:39:32.295095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:39:32.295134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:39:32.295149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T23:39:32.295154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T23:39:32.119Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 175 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "d45eb8cd-b5e7-45f9-8e90-5df544bf4d95" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:44582 10.132.0.43:443 10.132.0.10:34102 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:39:33.656452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:39:33.656485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:39:33.656499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:39:33.656504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T23:39:33.589Z] "DELETE /v1/api-keys/6b64cb23-2da9-46e6-9eac-78fb2bd960f9 HTTP/1.1" 200 - via_upstream - "-" 0 321 67 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "4bd96df1-fb10-440e-94b5-76e5f4572c76" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:44582 10.132.0.43:443 10.132.0.10:34116 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:39:33.866940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:39:33.866973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:39:33.866986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T23:39:33.866991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T23:39:33.798Z] "DELETE /v1/api-keys/d14fcd61-d818-4974-8686-09cb698df723 HTTP/1.1" 200 - via_upstream - "-" 0 321 68 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "5ace16db-deb8-4297-8c75-f2314ae72431" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:44582 10.132.0.43:443 10.132.0.10:34126 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T23:39:38.267Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 6 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "ade764b2-4be3-46c7-8089-d2681d9c38db" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.43:443 10.132.0.10:37874 - - 2026-10-30T23:43:05.070852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T23:43:05.070891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T23:43:05.070909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T23:43:05.070914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T23:43:04.996Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 73 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "26af8223-9127-4f2b-867d-335c28a96c3d" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:32780 10.132.0.43:443 10.132.0.10:34642 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T23:43:27.574Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 41 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "a5e72c41-d65e-405b-ba05-fe6b13fa666b" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.43:443 10.132.0.10:50998 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:43:48.498062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:45:03.565939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:46:30.802724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:47:05.107736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:48:18.359707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:51:22.613877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:53:28.966754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:03:43.054291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:03:43.370435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:03:43.370482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:03:43.370504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:03:43.370512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:03:43.290Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 80 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "230fad02-83b6-4dbe-ad78-bdc77bccf569" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:51948 10.132.0.43:443 10.132.0.10:34564 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:04:05.638388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:04:46.500012Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T00:04:48.257983Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:04:48.258008Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:04:48.258012Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:04:48.258017Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T00:04:48.225Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 32 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "e1479b46-c8d1-4659-9485-0d58f9d150ca" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.10:33670 - v1-completions-path 2026-10-31T00:04:50.608969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:06.275001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:08.281917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:05:24.468Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 82 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "bc10aae9-7c8a-4733-b7f5-033ed3d6cec0" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:58448 10.132.0.43:443 10.132.0.10:43042 - v1-completions-path 2026-10-31T00:05:25.205095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:27.069620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:29.948924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:38.084204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:05:45.531Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 72 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "0e91fb6e-7220-4d8b-9eea-39faa4cf96ea" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:34858 10.132.0.43:443 10.132.0.10:35334 - v1-completions-path 2026-10-31T00:05:46.278657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T00:05:46.228Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 54 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "d0d16c2e-0c85-48e2-b78a-01dba8222281" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:34858 10.132.0.43:443 10.132.0.10:35348 - v1-completions-path 2026-10-31T00:06:02.478079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:12.820118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:14.593970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:06:21.688Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "2a5a7383-764f-4bdc-a04e-72c1eb8c3b60" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:34858 10.132.0.43:443 10.132.0.10:38568 - v1-completions-path 2026-10-31T00:06:33.738509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:35.441128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:51.918904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:54.172530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:10.590510Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:12.321346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:26.511524Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T00:07:28.517521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:39.218799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:41.972809Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:03.532028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:08:03.532057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T00:08:03.532079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:08:03.532102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:08:03.532110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:08:03.468Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 63 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "5adef576-129d-4bf7-bdbf-d4031acd8d44" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:55304 10.132.0.43:443 10.132.0.10:47328 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:08:07.920175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:14.216018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:08:14.216063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:08:14.216084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:08:14.216091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:08:14.153Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 63 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "783f93d8-8c22-4766-b14e-952d3aa4d6ef" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:43258 10.132.0.43:443 10.132.0.10:58962 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:08:26.193489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:36.508300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:53.118196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:56.223782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:10:19.171134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:10:19.171171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:10:19.171188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:10:19.171193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:10:19.050Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 121 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8294eb3e-7b17-4bd0-aed1-d53ad18417be" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:33804 10.132.0.43:443 10.132.0.10:45156 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:11:35.855942Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:11:35.855967Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:11:35.855970Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:11:35.855974Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T00:11:35.811Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 44 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "818088d0-6673-41b4-857e-95730963f063" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.43:443 10.132.0.10:42476 - v1-completions-path 2026-10-31T00:11:54.601667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:09.574081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:11.314690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:28.591105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:13:50.359331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:13:50.359371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:13:50.359389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:13:50.359393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T00:13:50.293Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 66 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "3f3ef676-0b75-46bf-936d-5863f4de1d76" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:58810 10.132.0.43:443 10.132.0.10:48764 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:13:52.120719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:13:52.120754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:13:52.120769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:13:52.120774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:13:52.067Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 52 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "9447d8d4-4020-49af-84cd-c2659b6be6f8" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:58816 10.132.0.43:443 10.132.0.10:48766 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:13:56.135014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:12.559030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:28.538131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:40.458263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:43.522525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:52.376875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:54.819923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:15:13.127472Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:02.649735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:07.763992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:10.534414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:18:10.534464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:18:10.534484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:18:10.534491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T00:18:10.671414Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-31T00:18:10.464Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 70 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "beeb8869-e1b7-468a-aa59-4e07e0d3d58f" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.241:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.43:55470 10.132.0.43:443 10.132.0.10:53670 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:18:10.592Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 79 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "61e50ba9-5b7a-4c27-90be-ec51603a6536" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.43:36772 10.132.0.43:443 10.132.0.10:53684 - v1-catch-all-path 2026-10-31T00:18:22.846825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:24.388940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:38.631803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:49.664184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8