2026-10-30T21:58:33.478697Z info FLAG: --concurrency="0" 2026-10-30T21:58:33.478714Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T21:58:33.478718Z info FLAG: --help="false" 2026-10-30T21:58:33.478720Z info FLAG: --log_as_json="false" 2026-10-30T21:58:33.478722Z info FLAG: --log_caller="" 2026-10-30T21:58:33.478724Z info FLAG: --log_output_level="default:info" 2026-10-30T21:58:33.478726Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T21:58:33.478731Z info FLAG: --log_target="[stdout]" 2026-10-30T21:58:33.478733Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T21:58:33.478735Z info FLAG: --outlierLogPath="" 2026-10-30T21:58:33.478737Z info FLAG: --profiling="true" 2026-10-30T21:58:33.478739Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T21:58:33.478741Z info FLAG: --proxyLogLevel="warning" 2026-10-30T21:58:33.478743Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T21:58:33.478745Z info FLAG: --stsPort="0" 2026-10-30T21:58:33.478747Z info FLAG: --templateFile="" 2026-10-30T21:58:33.478748Z info FLAG: --tokenManagerPlugin="" 2026-10-30T21:58:33.478751Z info FLAG: --vklog="0" 2026-10-30T21:58:33.478753Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T21:58:33.478885Z info Proxy role ips=[10.133.0.32] type=router id=maas-default-gateway-openshift-default-67bf986f99-vmh57.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T21:58:33.478963Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T21:58:33.480163Z info cpu limit detected as 2, setting concurrency 2026-10-30T21:58:33.480738Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T21:58:33.480748Z info JWT policy is third-party-jwt 2026-10-30T21:58:33.480751Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T21:58:33.482205Z info Starting default Istio SDS Server 2026-10-30T21:58:33.482229Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T21:58:33.482259Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T21:58:33.482607Z info Opening status port 15020 2026-10-30T21:58:33.483391Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T21:58:33.484644Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T21:58:33.485415Z info Starting proxy agent 2026-10-30T21:58:33.485445Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T21:58:33.495288Z info sds Starting SDS grpc server 2026-10-30T21:58:33.495306Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T21:58:33.551953Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T21:58:33.587819Z info cache generated new workload certificate resourceName=default latency=103.955926ms ttl=23h59m59.412184298s 2026-10-30T21:58:33.587848Z info cache Root cert has changed, start rotating root cert 2026-10-30T21:58:33.587877Z info cache returned workload trust anchor from cache ttl=23h59m59.412123625s 2026-10-30T21:58:33.708028Z info ads ADS: new connection for node:1 2026-10-30T21:58:33.708107Z info cache returned workload certificate from cache ttl=23h59m59.291894566s 2026-10-30T21:58:33.708333Z info ads ADS: new connection for node:2 2026-10-30T21:58:33.708404Z info cache returned workload trust anchor from cache ttl=23h59m59.291597144s 2026-10-30T21:58:33.788125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:58:41.611651Z info Readiness succeeded in 8.135500024s 2026-10-30T21:58:41.612098Z info Envoy proxy is ready 2026-10-30T21:58:45.356366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:58:48.733782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T21:59:23.744Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 63 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "737db0c4-77b3-4d71-b597-82554e1b4dc9" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.32:443 10.132.0.12:56354 - v1-model-routing 2026-10-30T22:04:24.704273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:04:24.704309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:04:24.704324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:04:24.704329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:04:24.585Z] "DELETE /v1/api-keys/27f9395f-de0a-4940-96a5-d16d6fb2ae0d HTTP/1.1" 200 - via_upstream - "-" 0 370 119 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "64db4338-ce2a-41c4-ac81-b6eb8e9c879a" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:33520 10.133.0.32:443 10.132.0.12:51460 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:04:25.549538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:25.549584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:25.549604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:04:25.549610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:04:25.416Z] "DELETE /v1/api-keys/4fa5806d-e0ee-4794-8258-d8cfde6bd942 HTTP/1.1" 200 - via_upstream - "-" 0 321 133 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "eafa34a2-cca3-403b-94af-7d46060d3198" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:45840 10.133.0.32:443 10.132.0.12:51476 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:04:25.748Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 88 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "0c0cbb16-0d82-432a-aad9-3105ec25bf07" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.32:443 10.132.0.12:51480 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:04:28.779803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:28.779838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:28.779851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:28.779856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:04:28.657Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 122 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "f19daa9f-7d29-4a2c-bf18-eb02928b7723" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:45840 10.133.0.32:443 10.132.0.12:51496 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:04:29.760567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:29.760602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:29.760616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:29.760621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:04:29.630Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 130 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "e6e18a1b-c40a-47d9-9f1a-fa1f49d5d007" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:45840 10.133.0.32:443 10.132.0.12:51510 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:04:31.587307Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:04:31.587334Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:04:31.587338Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:04:31.587342Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T22:04:31.555Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 32 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "f4549f03-186d-4877-832b-062ac15210df" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.32:443 10.132.0.12:51516 - v1-completions-path [2026-10-30T22:04:44.646Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 54 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "2f56e824-59e1-4a06-9763-db28dbc3c302" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.32:443 10.132.0.12:39504 - v1-completions-path [2026-10-30T22:04:45.087Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 9 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "e2bf5c75-b21d-4baa-8185-9487b0a82353" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.32:443 10.132.0.12:39520 - - 2026-10-30T22:04:46.054094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:46.054128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:46.054140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:04:46.054144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:04:45.837Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 8 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "09fc436a-28aa-4eea-8477-2edfa7a8a8c3" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.32:443 10.132.0.12:39522 - - [2026-10-30T22:04:46.045Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 8 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "94974df4-3a13-4a11-927c-82032be27b10" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:45840 10.133.0.32:443 10.132.0.12:39538 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T22:04:48.366466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:05:05.187255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:11:22.235Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 385 90 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "fb1be444-fa2d-46e0-bc47-537241f326e4" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:33006 10.133.0.32:443 10.132.0.12:55718 - v1-chat-completions-path 2026-10-30T22:11:59.115998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:12:30.170294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:13:11.013305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:14:14.029960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:26:33.647806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:27:12.603055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:28:22.017264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:28:53.784460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:30:03.052956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:30:51.470399Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T22:31:32.954550Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:31:56.588527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:32:41.975792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T22:32:42.017830Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:32:42.017852Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:32:42.017855Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:32:42.017859Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T22:32:41.968Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 48 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "b8bc4b47-13c6-44f7-9540-2ed3044ff963" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.32:443 10.132.0.12:56372 - v1-completions-path 2026-10-30T22:32:51.991574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:32:57.453912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:32:57.453943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:32:57.453956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:32:57.453961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:32:57.331Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 122 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "2d6c30b1-cebe-464a-bc2b-8a37b03d2af3" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:45948 10.133.0.32:443 10.132.0.12:37314 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:32:59.176Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 81 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "0993327c-15f2-44c8-8209-0459ba72d383" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:57058 10.133.0.32:443 10.132.0.12:37324 - v1-completions-path 2026-10-30T22:33:10.233377Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T22:33:14.848924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:33:19.710718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:33:46.695541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:34:02.262580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:34:14.616304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T22:34:14.556Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "1a533195-9b27-4feb-b3b7-3568f89081ae" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:57058 10.133.0.32:443 10.132.0.12:50406 - v1-completions-path 2026-10-30T22:34:35.844993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:34:48.515844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:34:53.692131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:35:24.766704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:35:29.632893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:35:53.037053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:35:59.761971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:36:28.665195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:36:50.688445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:37:03.956907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:37:10.294757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:37:37.925107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:37:43.649447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:38:06.659944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:38:15.456869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:38:15.456904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:38:15.456920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:38:15.456924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T22:38:15.342Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 114 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "2b7c7f30-16af-4401-b354-6622da6a870d" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:38118 10.133.0.32:443 10.132.0.12:42850 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:38:29.821823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:38:40.748939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:38:59.720560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:39:05.826688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:41:28.427085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:41:34.643999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:43:14.042259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:43:31.454680Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:43:36.365716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:43:46.433Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 66 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "0014cb6a-f229-4fcb-94b9-bfe712387bbf" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:33006 10.133.0.32:443 10.132.0.12:48292 - v1-completions-path 2026-10-30T22:44:00.738151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:46:07.022524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:46:50.787653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:19.088928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:34.779183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:43.500386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:57.584931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:48:02.488962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:48:25.774535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:52:07.389465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:52:18.362558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:52:25.687Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 59 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "64b175da-a7bc-4cc3-8cd6-eedad656080c" "maas.apps.cf00f13b0d8e97273a94.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.32:443 10.132.0.12:40010 - v1-catch-all-path 2026-10-30T22:52:39.494279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:52:44.322292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:52:58.688305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:53:10.464210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8