2026-11-02T13:50:08.898688Z info FLAG: --concurrency="0" 2026-11-02T13:50:08.898704Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T13:50:08.898708Z info FLAG: --help="false" 2026-11-02T13:50:08.898711Z info FLAG: --log_as_json="false" 2026-11-02T13:50:08.898713Z info FLAG: --log_caller="" 2026-11-02T13:50:08.898715Z info FLAG: --log_output_level="default:info" 2026-11-02T13:50:08.898717Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T13:50:08.898721Z info FLAG: --log_target="[stdout]" 2026-11-02T13:50:08.898723Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T13:50:08.898725Z info FLAG: --outlierLogPath="" 2026-11-02T13:50:08.898727Z info FLAG: --profiling="true" 2026-11-02T13:50:08.898729Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T13:50:08.898731Z info FLAG: --proxyLogLevel="warning" 2026-11-02T13:50:08.898733Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T13:50:08.898736Z info FLAG: --stsPort="0" 2026-11-02T13:50:08.898737Z info FLAG: --templateFile="" 2026-11-02T13:50:08.898739Z info FLAG: --tokenManagerPlugin="" 2026-11-02T13:50:08.898742Z info FLAG: --vklog="0" 2026-11-02T13:50:08.898744Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T13:50:08.898871Z info Proxy role ips=[10.133.1.78] type=router id=maas-default-gateway-openshift-default-6dcf757899-pk25x.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T13:50:08.898914Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T13:50:08.900103Z info cpu limit detected as 2, setting concurrency 2026-11-02T13:50:08.900288Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T13:50:08.900299Z info JWT policy is third-party-jwt 2026-11-02T13:50:08.900302Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T13:50:08.901726Z info Starting default Istio SDS Server 2026-11-02T13:50:08.901757Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T13:50:08.901781Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T13:50:08.901794Z info Opening status port 15020 2026-11-02T13:50:08.902902Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T13:50:08.904613Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T13:50:08.906375Z info sds Starting SDS grpc server 2026-11-02T13:50:08.906392Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T13:50:08.907109Z info Starting proxy agent 2026-11-02T13:50:08.907204Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T13:50:08.971174Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T13:50:09.021410Z info cache generated new workload certificate resourceName=default latency=118.717967ms ttl=23h59m59.978593212s 2026-11-02T13:50:09.021444Z info cache Root cert has changed, start rotating root cert 2026-11-02T13:50:09.021478Z info cache returned workload trust anchor from cache ttl=23h59m59.978522329s 2026-11-02T13:50:09.118325Z info ads ADS: new connection for node:1 2026-11-02T13:50:09.118385Z info cache returned workload certificate from cache ttl=23h59m59.881616046s 2026-11-02T13:50:09.118585Z info ads ADS: new connection for node:2 2026-11-02T13:50:09.118666Z info cache returned workload trust anchor from cache ttl=23h59m59.881335977s 2026-11-02T13:50:09.202403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:50:18.165562Z info Readiness succeeded in 9.269419882s 2026-11-02T13:50:18.165868Z info Envoy proxy is ready 2026-11-02T13:51:32.744310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:55:37.690921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:55:42.876612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:55:47.567Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 86 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "409420dd-9f07-4d00-b20a-b06f1ae807d6" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.78:55066 10.133.1.78:443 10.132.0.12:38890 - v1-completions-path 2026-11-02T13:55:49.978481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T13:55:49.859Z] "DELETE /v1/api-keys/8244ef37-b754-4420-88f5-29af5b70ef37 HTTP/1.1" 200 - via_upstream - "-" 0 369 119 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "7b2c6a0d-1b83-4a3c-9f47-615168630c0e" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.142:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.78:42664 10.133.1.78:443 10.132.0.12:38900 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:56:03.944722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:14.807727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:21.476241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:50.279587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:56.866698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:03.019384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:57:11.650Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "748e36a7-3eec-44d8-ae52-6768fde76473" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.78:55066 10.133.1.78:443 10.132.0.12:60818 - v1-completions-path [2026-11-02T13:57:16.559Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 71 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "bf69a095-9476-49bd-92f9-0076262e5548" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.78:46058 10.133.1.78:443 10.132.0.12:60826 - v1-completions-path [2026-11-02T13:57:18.020Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 67 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "75ad8d8d-4295-49e9-b3d2-7df0b34681b9" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.78:46058 10.133.1.78:443 10.132.0.12:60842 - v1-completions-path 2026-11-02T13:57:34.972574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:45.488343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:52.413280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:58.769821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:10.195751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:58:16.637Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "8f4ffcb4-be75-4f49-bd67-f14b92acb4f3" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.78:55066 10.133.1.78:443 10.132.0.12:38742 - v1-completions-path [2026-11-02T13:58:18.833Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "c7fe7c82-a5bc-4aea-ba8c-5c67cd6766c6" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.78:55066 10.133.1.78:443 10.132.0.12:38746 - v1-completions-path 2026-11-02T13:58:19.930645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T13:58:19.818Z] "DELETE /v1/api-keys/fc163485-7b50-43ff-9113-22880c250660 HTTP/1.1" 200 - via_upstream - "-" 0 367 112 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "9b09a947-02ec-4664-b9f1-4966f5767a3b" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.134.0.107:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.78:54518 10.133.1.78:443 10.132.0.12:38752 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:58:33.595469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:44.283457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:47.683244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:07.310935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:13.710795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:37.141269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:58.964568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:19.051355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:31.551096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:51.467675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:02.268943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:12.885124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:23.823671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:34.413283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:37.219218Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:01:37.219243Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:01:37.219246Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:01:37.219250Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T14:01:37.195Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 23 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "5696f661-bcbb-425c-bec0-10d1240e0e38" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.78:443 10.132.0.12:50732 - v1-completions-path 2026-11-02T14:01:41.714393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T14:01:41.645Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 86 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "03830a27-cbe3-4b84-8c81-e9a719fcb4be" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.78:35286 10.133.1.78:443 10.132.0.12:46266 - v1-completions-path