2026-11-04T08:53:40.343310Z info FLAG: --concurrency="0" 2026-11-04T08:53:40.343329Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T08:53:40.343333Z info FLAG: --help="false" 2026-11-04T08:53:40.343335Z info FLAG: --log_as_json="false" 2026-11-04T08:53:40.343338Z info FLAG: --log_caller="" 2026-11-04T08:53:40.343339Z info FLAG: --log_output_level="default:info" 2026-11-04T08:53:40.343342Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T08:53:40.343346Z info FLAG: --log_target="[stdout]" 2026-11-04T08:53:40.343349Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T08:53:40.343351Z info FLAG: --outlierLogPath="" 2026-11-04T08:53:40.343353Z info FLAG: --profiling="true" 2026-11-04T08:53:40.343355Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T08:53:40.343357Z info FLAG: --proxyLogLevel="warning" 2026-11-04T08:53:40.343358Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T08:53:40.343360Z info FLAG: --stsPort="0" 2026-11-04T08:53:40.343362Z info FLAG: --templateFile="" 2026-11-04T08:53:40.343365Z info FLAG: --tokenManagerPlugin="" 2026-11-04T08:53:40.343368Z info FLAG: --vklog="0" 2026-11-04T08:53:40.343370Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T08:53:40.343514Z info Proxy role ips=[10.134.0.38] type=router id=maas-default-gateway-openshift-default-855f9574cf-gdmzl.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T08:53:40.343561Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T08:53:40.344558Z info cpu limit detected as 2, setting concurrency 2026-11-04T08:53:40.344817Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T08:53:40.344827Z info JWT policy is third-party-jwt 2026-11-04T08:53:40.344830Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T08:53:40.346513Z info Starting default Istio SDS Server 2026-11-04T08:53:40.346541Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T08:53:40.346564Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T08:53:40.347251Z info Opening status port 15020 2026-11-04T08:53:40.347613Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T08:53:40.348234Z info sds Starting SDS grpc server 2026-11-04T08:53:40.348326Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T08:53:40.348977Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T08:53:40.349769Z info Starting proxy agent 2026-11-04T08:53:40.349803Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T08:53:40.412063Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T08:53:40.521189Z info ads ADS: new connection for node:1 2026-11-04T08:53:40.521441Z info ads ADS: new connection for node:2 2026-11-04T08:53:40.535812Z info cache generated new workload certificate resourceName=default latency=187.388894ms ttl=23h59m59.464190974s 2026-11-04T08:53:40.535839Z info cache Root cert has changed, start rotating root cert 2026-11-04T08:53:40.535871Z info cache returned workload trust anchor from cache ttl=23h59m59.464129085s 2026-11-04T08:53:40.535889Z info cache returned workload certificate from cache ttl=23h59m59.464110904s 2026-11-04T08:53:40.535978Z info cache returned workload trust anchor from cache ttl=23h59m59.464024676s 2026-11-04T08:53:40.536222Z info cache returned workload trust anchor from cache ttl=23h59m59.463778923s 2026-11-04T08:53:40.580857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:53:46.944194Z info Readiness succeeded in 6.603111042s 2026-11-04T08:53:46.944502Z info Envoy proxy is ready 2026-11-04T08:53:53.370079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:53:58.131874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:54:01.775349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:54:06.308364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:54:09.330248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:54:12.932900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:54:17.174307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:54:42.927166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T08:54:42.795Z] "DELETE /v1/api-keys/c11dbd6a-b521-40aa-908d-2cf8dbd6bc4b HTTP/1.1" 200 - via_upstream - "-" 0 365 131 - "34.228.250.194,10.132.0.16" "curl/7.76.1" "c73e15ee-c2e9-4664-81d2-f1ed73c40995" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:51000 10.134.0.38:443 10.132.0.16:55894 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T08:54:43.511099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T08:54:43.323Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 187 - "34.228.250.194,10.132.0.16" "curl/7.76.1" "f595f56d-6215-4798-8003-49221d6b2054" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:51010 10.134.0.38:443 10.132.0.16:55906 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T08:55:02.681600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T08:55:02.534Z] "DELETE /v1/api-keys/65d52506-e0f4-45d4-86ff-9a0529aa250f HTTP/1.1" 200 - via_upstream - "-" 0 321 147 - "34.228.250.194,10.132.0.16" "python-requests/2.33.0" "e343e4a7-7745-4241-8d75-de6ed8951b03" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:51010 10.134.0.38:443 10.132.0.16:58906 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T08:55:02.712Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 88 - "34.228.250.194,10.132.0.16" "python-requests/2.33.0" "2f4ba380-4d1b-40e1-b1b0-6275110cf3a4" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.38:443 10.132.0.16:58914 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T08:55:19.747Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 204 - "34.228.250.194,10.132.0.16" "python-requests/2.33.0" "4dfcc9c2-f5cc-46b5-a291-eae95509f1b4" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:43154 10.134.0.38:443 10.132.0.16:56998 - v1-completions-path 2026-11-04T08:55:21.245923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T08:55:21.065Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 180 - "34.228.250.194,10.132.0.16" "python-requests/2.33.0" "a66950b0-876c-4cb2-9ff5-910d3e425d67" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:51010 10.134.0.38:443 10.132.0.16:57010 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T08:55:53.029082Z info ads ADS: new connection for node:3 2026-11-04T08:55:53.034672Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T08:55:53.035152Z info cache read certificate from file resource=file-root:system 2026-11-04T08:56:45.557462Z info ads ADS: "" 3 terminated 2026-11-04T08:57:00.312507Z info ads ADS: new connection for node:4 2026-11-04T08:57:00.320552Z info cache read certificate from file resource=file-root:system 2026-11-04T08:57:02.087350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:57:09.649450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:57:15.169318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T08:57:15.034Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 329 134 - "34.228.250.194,10.132.0.16" "python-requests/2.33.0" "ff0c7bfe-08f3-4765-9ade-dfa8b31d99c1" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:53658 10.134.0.38:443 10.132.0.16:55166 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T08:57:15.443Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 4603 115 - "34.228.250.194,10.132.0.16" "python-requests/2.33.0" "f2856191-2f36-4715-920c-5b5d06dc329f" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:37680 10.134.0.38:443 10.132.0.16:55178 - v1-chat-completions-path 2026-11-04T08:57:17.126208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T08:57:27.192Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 16 - "34.228.250.194,10.132.0.16" "python-requests/2.33.0" "b84fba76-33c7-4e0f-a43b-5c3489b9c2b6" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.38:443 10.132.0.16:33758 - - [2026-11-04T08:57:41.531Z] "POST /llm/e2e-dft-d615b5/anything/e2e-dft-d615b5-a7bea5 HTTP/1.1" 401 - - "-" 109 88 78 - "34.228.250.194,10.132.0.16" "python-requests/2.33.0" "b9876f94-47d9-4980-bf52-693e39aa8465" "maas.apps.a3dc5cee932be05f4d88.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-d615b5.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.16:53164 - llm.external-model-e2e-dft-d615b5-00770ffddbe7.2 2026-11-04T08:57:53.638170Z info ads ADS: "" 4 terminated with stream closed 2026-11-04T08:57:53.700268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:57:55.918420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T08:58:08.933550Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8