2026-10-30T22:43:49.449769Z info FLAG: --concurrency="0" 2026-10-30T22:43:49.449787Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T22:43:49.449791Z info FLAG: --help="false" 2026-10-30T22:43:49.449793Z info FLAG: --log_as_json="false" 2026-10-30T22:43:49.449795Z info FLAG: --log_caller="" 2026-10-30T22:43:49.449797Z info FLAG: --log_output_level="default:info" 2026-10-30T22:43:49.449799Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T22:43:49.449803Z info FLAG: --log_target="[stdout]" 2026-10-30T22:43:49.449806Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T22:43:49.449808Z info FLAG: --outlierLogPath="" 2026-10-30T22:43:49.449810Z info FLAG: --profiling="true" 2026-10-30T22:43:49.449812Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T22:43:49.449813Z info FLAG: --proxyLogLevel="warning" 2026-10-30T22:43:49.449815Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T22:43:49.449817Z info FLAG: --stsPort="0" 2026-10-30T22:43:49.449819Z info FLAG: --templateFile="" 2026-10-30T22:43:49.449822Z info FLAG: --tokenManagerPlugin="" 2026-10-30T22:43:49.449825Z info FLAG: --vklog="0" 2026-10-30T22:43:49.449827Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T22:43:49.449964Z info Proxy role ips=[10.132.0.149] type=router id=maas-default-gateway-openshift-default-76597d6855-vfb7s.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T22:43:49.450013Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T22:43:49.451048Z info cpu limit detected as 2, setting concurrency 2026-10-30T22:43:49.451736Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T22:43:49.451750Z info JWT policy is third-party-jwt 2026-10-30T22:43:49.451753Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T22:43:49.454034Z info Starting default Istio SDS Server 2026-10-30T22:43:49.454070Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T22:43:49.454088Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T22:43:49.454001Z info Opening status port 15020 2026-10-30T22:43:49.454785Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T22:43:49.456014Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T22:43:49.456763Z info Starting proxy agent 2026-10-30T22:43:49.456793Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T22:43:49.465952Z info sds Starting SDS grpc server 2026-10-30T22:43:49.465971Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T22:43:49.519362Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T22:43:49.646241Z info cache generated new workload certificate resourceName=default latency=191.208392ms ttl=23h59m59.353761984s 2026-10-30T22:43:49.646277Z info cache Root cert has changed, start rotating root cert 2026-10-30T22:43:49.646313Z info cache returned workload trust anchor from cache ttl=23h59m59.353687813s 2026-10-30T22:43:49.668580Z info ads ADS: new connection for node:1 2026-10-30T22:43:49.668879Z info ads ADS: new connection for node:2 2026-10-30T22:43:49.669211Z info cache returned workload certificate from cache ttl=23h59m59.330793207s 2026-10-30T22:43:49.669261Z info cache returned workload trust anchor from cache ttl=23h59m59.330741515s 2026-10-30T22:43:49.748256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:43:57.677517Z info Readiness succeeded in 8.230003278s 2026-10-30T22:43:57.678045Z info Envoy proxy is ready 2026-10-30T22:44:15.061620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:44:28.346694Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T22:44:39.153Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 80 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e9081871-262e-4460-a42d-af9b7708f451" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:47488 10.132.0.149:443 10.132.0.20:52452 - v1-completions-path [2026-10-30T22:44:40.229Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 56 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7934e1b3-8121-4f86-b3aa-6fd6736a09dc" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:47488 10.132.0.149:443 10.132.0.20:52466 - v1-completions-path [2026-10-30T22:44:40.737Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "5c66403a-2e83-4f40-8e19-e16f5ec740cd" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:47494 10.132.0.149:443 10.132.0.20:52472 - v1-completions-path 2026-10-30T22:44:59.471861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:45:10.322173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:45:16.844371Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:45:30.646000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:45:30.646050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:45:30.646071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:45:30.646078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:45:30.527Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 118 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7a95c7fb-9ac5-4ff3-8eff-42ba41f374b7" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.133.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.149:47662 10.132.0.149:443 10.132.0.20:46376 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:45:32.463Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 55 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "0bb0aa97-7967-49bc-b330-0b1955325c56" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:47494 10.132.0.149:443 10.132.0.20:36338 - v1-completions-path 2026-10-30T22:45:33.803015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T22:45:33.743Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "da6bc222-d475-4632-8b11-5931c3165675" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:47494 10.132.0.149:443 10.132.0.20:36344 - v1-completions-path 2026-10-30T22:45:48.485958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:45:53.163291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:46:19.826863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:46:26.433564Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:46:52.389970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:47:14.680372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:47:27.818828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:47:34.407614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:48:01.880179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:48:07.630388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:48:27.745022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:48:47.764490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:48:58.718883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:49:18.061725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:49:24.035554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:53:25.813735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:53:43.393168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:53:48.101819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:53:58.525358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T22:53:58.462Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 78 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "206aee62-c212-4115-b3f9-4ffd88d2850d" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:56740 10.132.0.149:443 10.132.0.20:49676 - v1-completions-path 2026-10-30T22:54:12.692632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:56:16.271341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:56:16.271377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:56:16.271391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:56:16.271396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:56:16.207Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 64 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3d3e9b1c-e121-441b-a170-95b8c2a4f7a2" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.133.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.149:43710 10.132.0.149:443 10.132.0.20:47960 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:56:25.784186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:57:08.292220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:57:39.068427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:57:55.021539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:58:12.293376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:58:24.701306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:58:29.855064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T22:58:57.577342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T23:02:33.874935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T23:02:39.395232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T23:02:39.395278Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T23:02:39.395292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T23:02:39.395297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T23:02:39.271Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 123 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "386fbb5d-578e-48b7-9cc3-a3109a43cf77" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.133.0.108:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.149:56068 10.132.0.149:443 10.132.0.20:42694 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:02:40.381349Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T23:02:40.308Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 73 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2c70e7db-d6db-4462-a971-63b6332ec4f2" "maas.apps.5f5985d19b2baf18959c.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:43892 10.132.0.149:443 10.132.0.20:42710 - v1-catch-all-model-routing 2026-10-30T23:02:45.338253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T23:03:08.805805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T23:03:13.440044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T23:03:30.033857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T23:03:41.643907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9