2026-11-02T10:33:27.105616Z info FLAG: --concurrency="0" 2026-11-02T10:33:27.105635Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T10:33:27.105639Z info FLAG: --help="false" 2026-11-02T10:33:27.105642Z info FLAG: --log_as_json="false" 2026-11-02T10:33:27.105644Z info FLAG: --log_caller="" 2026-11-02T10:33:27.105646Z info FLAG: --log_output_level="default:info" 2026-11-02T10:33:27.105647Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T10:33:27.105652Z info FLAG: --log_target="[stdout]" 2026-11-02T10:33:27.105654Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T10:33:27.105656Z info FLAG: --outlierLogPath="" 2026-11-02T10:33:27.105658Z info FLAG: --profiling="true" 2026-11-02T10:33:27.105660Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T10:33:27.105661Z info FLAG: --proxyLogLevel="warning" 2026-11-02T10:33:27.105663Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T10:33:27.105665Z info FLAG: --stsPort="0" 2026-11-02T10:33:27.105667Z info FLAG: --templateFile="" 2026-11-02T10:33:27.105669Z info FLAG: --tokenManagerPlugin="" 2026-11-02T10:33:27.105671Z info FLAG: --vklog="0" 2026-11-02T10:33:27.105674Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T10:33:27.105818Z info Proxy role ips=[10.134.1.29] type=router id=maas-default-gateway-openshift-default-75fd9f5d47-6cftx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T10:33:27.105865Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T10:33:27.106809Z info cpu limit detected as 2, setting concurrency 2026-11-02T10:33:27.106993Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T10:33:27.107004Z info JWT policy is third-party-jwt 2026-11-02T10:33:27.107007Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T10:33:27.108917Z info Starting default Istio SDS Server 2026-11-02T10:33:27.108942Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T10:33:27.108959Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T10:33:27.109601Z info Opening status port 15020 2026-11-02T10:33:27.110105Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T10:33:27.111543Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T10:33:27.112366Z info Starting proxy agent 2026-11-02T10:33:27.112405Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T10:33:27.122114Z info sds Starting SDS grpc server 2026-11-02T10:33:27.122131Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T10:33:27.173047Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T10:33:27.227240Z info cache generated new workload certificate resourceName=default latency=117.410855ms ttl=23h59m59.772762505s 2026-11-02T10:33:27.227271Z info cache Root cert has changed, start rotating root cert 2026-11-02T10:33:27.227302Z info cache returned workload trust anchor from cache ttl=23h59m59.772698331s 2026-11-02T10:33:27.269431Z info ads ADS: new connection for node:1 2026-11-02T10:33:27.269484Z info cache returned workload certificate from cache ttl=23h59m59.730517781s 2026-11-02T10:33:27.269670Z info ads ADS: new connection for node:2 2026-11-02T10:33:27.269732Z info cache returned workload trust anchor from cache ttl=23h59m59.730269177s 2026-11-02T10:33:27.348987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:33:36.006179Z info Readiness succeeded in 8.902780948s 2026-11-02T10:33:36.006534Z info Envoy proxy is ready 2026-11-02T10:34:45.901265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:38:24.328846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:38:28.085611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:38:44.485708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:38:54.866340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:38:58.222488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:39:02.079110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T10:39:02.004Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 75 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "514faf8a-3dfd-4a5b-aac1-bedaf53d4931" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "10.132.0.158:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.29:46092 10.134.1.29:443 10.132.0.19:59850 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T10:39:02.950Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 78 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "72e1b0a0-ad1e-4449-8bb0-fe7700e9599b" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.29:52936 10.134.1.29:443 10.132.0.19:59854 - v1-completions-path 2026-11-02T10:39:15.509005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:39:17.863370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:39:21.418717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T10:39:26.877Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 76 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "74176513-3baa-4c81-8b88-db34fd6e3241" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.29:41564 10.134.1.29:443 10.132.0.19:56932 - v1-completions-path [2026-11-02T10:39:27.538Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "9e814f3f-f7b1-4ed0-8675-3392b7f3bd54" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.29:41564 10.134.1.29:443 10.132.0.19:56946 - v1-completions-path [2026-11-02T10:39:29.461Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 66 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "a6db7de6-f5dc-4c04-b969-0c607204e67b" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.29:41564 10.134.1.29:443 10.132.0.19:56958 - v1-completions-path [2026-11-02T10:39:30.779Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "60ae24a8-9175-4739-b3f3-06f25c3afc64" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.29:52936 10.134.1.29:443 10.132.0.19:56970 - v1-completions-path 2026-11-02T10:39:31.405529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T10:39:31.338Z] "DELETE /v1/api-keys/4eaafc0a-95c3-405e-9871-ca9c2f73ee49 HTTP/1.1" 200 - via_upstream - "-" 0 363 66 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "5b96d435-1525-41ed-a388-8715590da7ef" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "10.132.0.158:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.29:58940 10.134.1.29:443 10.132.0.19:56978 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T10:39:43.093578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:39:53.381949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:39:55.615544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:39:59.191468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:40:04.813909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T10:40:09.386Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "88f08431-c0c9-407b-9ca4-8c8e565c7f8d" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.29:41564 10.134.1.29:443 10.132.0.19:49112 - v1-completions-path [2026-11-02T10:40:10.523Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 66 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "be5a7f9c-d963-4f7f-9d54-9038197b7e31" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.29:443 10.132.0.19:49124 - v1-completions-path 2026-11-02T10:40:22.223112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:40:32.504753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:40:34.171620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:40:41.637138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:40:45.470517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:41:00.210731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:41:20.230969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:41:30.422781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:41:40.583325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:41:50.744362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:42:01.030557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:42:11.251407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:42:21.501523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:42:31.703812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:42:41.939248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:42:52.230862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T10:42:58.456520Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T10:42:58.456543Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T10:42:58.456546Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T10:42:58.456550Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T10:42:58.431Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 25 - "52.71.36.72,10.132.0.19" "python-requests/2.33.0" "cd847cf6-5592-4c67-95a5-30b4c29c436f" "maas.apps.e930e379d4db695acbc5.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.29:443 10.132.0.19:40628 - v1-completions-path