2026-10-31T12:36:34.070312Z info FLAG: --concurrency="0" 2026-10-31T12:36:34.070332Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T12:36:34.070337Z info FLAG: --help="false" 2026-10-31T12:36:34.070339Z info FLAG: --log_as_json="false" 2026-10-31T12:36:34.070341Z info FLAG: --log_caller="" 2026-10-31T12:36:34.070343Z info FLAG: --log_output_level="default:info" 2026-10-31T12:36:34.070345Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T12:36:34.070350Z info FLAG: --log_target="[stdout]" 2026-10-31T12:36:34.070352Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T12:36:34.070354Z info FLAG: --outlierLogPath="" 2026-10-31T12:36:34.070356Z info FLAG: --profiling="true" 2026-10-31T12:36:34.070358Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T12:36:34.070360Z info FLAG: --proxyLogLevel="warning" 2026-10-31T12:36:34.070364Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T12:36:34.070366Z info FLAG: --stsPort="0" 2026-10-31T12:36:34.070368Z info FLAG: --templateFile="" 2026-10-31T12:36:34.070370Z info FLAG: --tokenManagerPlugin="" 2026-10-31T12:36:34.070373Z info FLAG: --vklog="0" 2026-10-31T12:36:34.070376Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T12:36:34.070574Z info Proxy role ips=[10.132.0.61] type=router id=maas-default-gateway-openshift-default-645cf464d7-7psf5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T12:36:34.070661Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T12:36:34.072095Z info cpu limit detected as 2, setting concurrency 2026-10-31T12:36:34.072533Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T12:36:34.072603Z info JWT policy is third-party-jwt 2026-10-31T12:36:34.072640Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T12:36:34.075485Z info Opening status port 15020 2026-10-31T12:36:34.075101Z info Starting default Istio SDS Server 2026-10-31T12:36:34.075857Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T12:36:34.075916Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T12:36:34.076864Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T12:36:34.077388Z info sds Starting SDS grpc server 2026-10-31T12:36:34.077406Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T12:36:34.079029Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T12:36:34.080097Z info Starting proxy agent 2026-10-31T12:36:34.080175Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T12:36:34.160600Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T12:36:34.262757Z info cache generated new workload certificate resourceName=default latency=185.226708ms ttl=23h59m59.737250176s 2026-10-31T12:36:34.262876Z info cache Root cert has changed, start rotating root cert 2026-10-31T12:36:34.262925Z info cache returned workload trust anchor from cache ttl=23h59m59.737075821s 2026-10-31T12:36:34.301399Z info ads ADS: new connection for node:1 2026-10-31T12:36:34.301478Z info cache returned workload certificate from cache ttl=23h59m59.698524098s 2026-10-31T12:36:34.303856Z info ads ADS: new connection for node:2 2026-10-31T12:36:34.303961Z info cache returned workload trust anchor from cache ttl=23h59m59.696051427s 2026-10-31T12:36:34.403999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:36:42.331266Z info Readiness succeeded in 8.264119314s 2026-10-31T12:36:42.331859Z info Envoy proxy is ready 2026-10-31T12:37:06.117371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:37:06.117413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:37:06.117429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:37:06.117435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T12:37:06.025Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 91 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "d02aae47-053b-445f-888d-b594a73ebe11" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:47794 10.132.0.61:443 10.132.0.9:39648 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:37:06.740Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 57 - "52.71.36.72,10.132.0.9" "curl/7.76.1" "27316a8f-f18a-424a-be47-f712cb7efe96" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.61:443 10.132.0.9:39656 - v1-model-routing 2026-10-31T12:39:25.538430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:25.538466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:25.538480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:25.538486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:39:26.054338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:26.054380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:26.054400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:26.054408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:39:26.233831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:26.233870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:26.233883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:39:26.233888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T12:39:25.400Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 137 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5d42e442-fc06-478e-a83d-38075beb944e" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:46436 10.132.0.61:443 10.132.0.9:51164 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:39:25.949Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 105 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "20ac9291-a1b4-4ec1-8606-2db0e6e648b5" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:46438 10.132.0.61:443 10.132.0.9:51174 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:39:26.076Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 157 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2185f1e7-a9ed-42d2-a67f-0230d4c7b26f" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:46436 10.132.0.61:443 10.132.0.9:51182 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:39:27.341791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:27.341841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:27.341862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:27.341870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T12:39:26.978Z] "DELETE /v1/api-keys/21c23df6-c871-4390-99ff-cdf0fbe9aee1 HTTP/1.1" 200 - via_upstream - "-" 0 321 363 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "af69fde1-8552-4838-866d-f47f6015f65b" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:46438 10.132.0.61:443 10.132.0.9:51190 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:39:28.253380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:28.253466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:28.253521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:39:28.253549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T12:39:28.104Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 149 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "c5e2fd1d-7c2e-47a6-90a6-bf3361775604" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:46438 10.132.0.61:443 10.132.0.9:51212 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:39:28.434282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:28.434397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:28.434452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:39:28.434485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:28.914504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:28.914601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:28.914689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:39:28.914705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T12:39:28.308Z] "DELETE /v1/api-keys/e81aacba-f4f3-4ede-91c4-9988b967dae8 HTTP/1.1" 200 - via_upstream - "-" 0 321 126 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3d634729-8d40-4e66-9482-8672815b976c" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:46436 10.132.0.61:443 10.132.0.9:51228 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:39:28.777Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 136 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "b5b60aaa-dd9f-44c8-bd1e-4553dfbf1f80" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:46436 10.132.0.61:443 10.132.0.9:51236 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:39:33.971Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 47 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "cdf06a11-5829-4ad1-9543-a1b2f0c7f289" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.61:443 10.132.0.9:49262 - v1-completions-path 2026-10-31T12:39:37.046710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T12:39:36.973Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 75 - "52.71.36.72,10.132.0.9" "-" "47349d14-7e2f-47f8-80ca-bb1f20880765" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:51388 10.132.0.61:443 10.132.0.9:49266 - v1-completions-path [2026-10-31T12:39:43.804Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 7 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e5c5fcac-3727-45b8-88fb-4a6ec5fa5e0c" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.61:443 10.132.0.9:49292 - - 2026-10-31T12:39:51.688645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:40:09.145184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:42:55.339261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:42:55.339402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:42:55.339475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:42:55.339557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T12:42:55.219Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 120 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "270d350b-dbdb-4096-b608-be07b844ca82" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:38174 10.132.0.61:443 10.132.0.9:38662 - odh-ai-gateway-infra.maas-api-route.4 2026-10-31T12:44:20.847703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:45:08.632335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:45:49.453020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:46:27.803039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:48:36.556060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:50:33.268319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T12:51:19.064213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:01:13.363107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:01:36.177884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:02:19.415007Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T13:02:19.415032Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T13:02:19.415035Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T13:02:19.415039Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T13:02:19.371Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 43 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "7c70a9eb-1669-4c60-b7c6-62a480f51c42" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.61:443 10.132.0.9:41370 - v1-completions-path 2026-10-31T13:02:22.084377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T13:02:27.557Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 71 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "fd6c9299-3822-4723-96ee-adf8c30e9e6c" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:54438 10.132.0.61:443 10.132.0.9:55556 - v1-completions-path 2026-10-31T13:02:40.297082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:02:42.354576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:02:59.094860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:03:00.831336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:03:03.833466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:03:12.155095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T13:03:17.991Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f41f9604-da42-4c7c-8856-aa90ffcf12fa" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:54438 10.132.0.61:443 10.132.0.9:45170 - v1-completions-path 2026-10-31T13:03:18.502693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-31T13:03:18.450Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "99d626e2-efc6-4bd6-8a95-24b762c83951" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:54438 10.132.0.61:443 10.132.0.9:45172 - v1-completions-path [2026-10-31T13:03:19.751Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1b88cbf5-6789-4e7c-b48f-a747dbee3701" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:46656 10.132.0.61:443 10.132.0.9:45182 - v1-completions-path [2026-10-31T13:03:21.147Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a7b1d114-dd8d-4159-8d9f-1e1fc8b31609" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:54438 10.132.0.61:443 10.132.0.9:45196 - v1-completions-path 2026-10-31T13:03:36.032080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:03:46.433540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:03:48.194874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T13:03:53.796Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "b5183a0b-3209-4200-8cac-b92c6110de0a" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:54438 10.132.0.61:443 10.132.0.9:57604 - v1-completions-path [2026-10-31T13:03:53.919Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9751c096-e913-4f27-a257-ef2fe83bfd0a" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:46656 10.132.0.61:443 10.132.0.9:57610 - v1-completions-path 2026-10-31T13:03:54.661613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T13:03:54.600Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ba52259a-d357-4182-9ee7-98972bca70f3" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:46656 10.132.0.61:443 10.132.0.9:47194 - v1-completions-path [2026-10-31T13:03:54.829Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "b68143b6-8b26-41a3-9229-dab68ae1ff77" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:54438 10.132.0.61:443 10.132.0.9:47206 - v1-completions-path 2026-10-31T13:04:06.798948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:04:08.462883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:04:24.921089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:04:28.016704Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T13:04:28.146435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:04:43.689267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:04:45.334999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:05:01.467925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:05:12.112422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:05:15.168234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:05:26.303193Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T13:05:33.709991Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:05:35.736712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:05:43.193566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:06:01.311076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:06:11.594570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:06:26.819807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:06:29.523087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:08:05.922704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:08:08.946020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:09:36.332032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:09:51.492434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:09:53.193725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:09:58.894059Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T13:09:58.894083Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T13:09:58.894086Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T13:09:58.894090Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T13:09:58.860Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 33 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "18c3943d-83bb-4887-9776-2c3b3507b697" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.61:443 10.132.0.9:54702 - v1-completions-path 2026-10-31T13:10:10.334211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:11:36.715715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:11:52.421917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:12:08.584820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:12:20.296732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:12:24.381663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:12:35.402054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:12:37.709990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:12:56.576620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:15:47.519318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:15:50.617232Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T13:15:50.518Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 98 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "6838f142-bbeb-4ca4-a4d1-0275fd2d3d8c" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.61:50682 10.132.0.61:443 10.132.0.9:36672 - v1-catch-all-path 2026-10-31T13:15:52.915244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:15:58.636908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:15:58.636952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:15:58.636975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:15:58.636982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T13:15:58.571Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 65 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4d2e918d-4996-47b4-aa64-4d85af81e561" "maas.apps.33349274580610682b39.prod.konflux-ocp-ci.dev" "10.133.0.183:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.61:50458 10.132.0.61:443 10.132.0.9:36686 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:16:10.859262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:16:12.745587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:16:27.125012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T13:16:37.941283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9