2026-10-31T18:33:23.674355Z info FLAG: --concurrency="0" 2026-10-31T18:33:23.674387Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T18:33:23.674393Z info FLAG: --help="false" 2026-10-31T18:33:23.674396Z info FLAG: --log_as_json="false" 2026-10-31T18:33:23.674399Z info FLAG: --log_caller="" 2026-10-31T18:33:23.674402Z info FLAG: --log_output_level="default:info" 2026-10-31T18:33:23.674405Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T18:33:23.674411Z info FLAG: --log_target="[stdout]" 2026-10-31T18:33:23.674415Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T18:33:23.674418Z info FLAG: --outlierLogPath="" 2026-10-31T18:33:23.674421Z info FLAG: --profiling="true" 2026-10-31T18:33:23.674424Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T18:33:23.674427Z info FLAG: --proxyLogLevel="warning" 2026-10-31T18:33:23.674430Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T18:33:23.674433Z info FLAG: --stsPort="0" 2026-10-31T18:33:23.674435Z info FLAG: --templateFile="" 2026-10-31T18:33:23.674438Z info FLAG: --tokenManagerPlugin="" 2026-10-31T18:33:23.674442Z info FLAG: --vklog="0" 2026-10-31T18:33:23.674445Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T18:33:23.674619Z info Proxy role ips=[10.133.0.41] type=router id=maas-default-gateway-openshift-default-55fbd65575-r9hdg.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T18:33:23.674674Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T18:33:23.675765Z info cpu limit detected as 2, setting concurrency 2026-10-31T18:33:23.676006Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T18:33:23.676019Z info JWT policy is third-party-jwt 2026-10-31T18:33:23.676023Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T18:33:23.677328Z info Starting default Istio SDS Server 2026-10-31T18:33:23.677350Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T18:33:23.677373Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T18:33:23.677702Z info Opening status port 15020 2026-10-31T18:33:23.678612Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T18:33:23.679163Z info sds Starting SDS grpc server 2026-10-31T18:33:23.679196Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T18:33:23.679887Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T18:33:23.680657Z info Starting proxy agent 2026-10-31T18:33:23.680688Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T18:33:23.746609Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T18:33:23.833821Z info cache generated new workload certificate resourceName=default latency=154.553914ms ttl=23h59m59.16618413s 2026-10-31T18:33:23.833857Z info cache Root cert has changed, start rotating root cert 2026-10-31T18:33:23.833887Z info cache returned workload trust anchor from cache ttl=23h59m59.166113669s 2026-10-31T18:33:23.864711Z info ads ADS: new connection for node:1 2026-10-31T18:33:23.864785Z info cache returned workload certificate from cache ttl=23h59m59.135216384s 2026-10-31T18:33:23.865014Z info ads ADS: new connection for node:2 2026-10-31T18:33:23.865087Z info cache returned workload trust anchor from cache ttl=23h59m59.134914366s 2026-10-31T18:33:23.954744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:33:32.511242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:33:33.417635Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:34.317932Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:35.667723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:33:36.921529Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:37.405155Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:38.797726Z info Readiness succeeded in 15.125981271s 2026-10-31T18:33:38.798051Z info Envoy proxy is ready 2026-10-31T18:33:51.103387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:34:01.342269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:34:11.547787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:34:14.878524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:34:18.822167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:34:21.851167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:34:26.479288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T18:34:58.663Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 16 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f8b9a7ce-b9ed-42cd-a6cd-6ab7cb067a69" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.41:443 10.132.0.9:37994 - - 2026-10-31T18:36:43.195393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:36:50.150797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:36:53.675861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:37:10.638702Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:37:20.868579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:37:31.040036Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:37:35.712169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:37:39.712596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:38:12.195483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:38:49.880994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T18:38:49.881031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T18:38:49.881043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T18:38:49.881048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T18:38:50.336735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:50.336782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:50.336795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T18:38:50.336800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-31T18:38:49.803Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 99 44 78 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5494e626-f8fa-41b2-a287-4fcd1b237ed8" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.41:55432 10.133.0.41:443 10.132.0.9:39466 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T18:38:50.263Z] "GET /v1/api-keys/bc622ad5-d2f1-4eca-9eb5-70605319c77c HTTP/1.1" 404 - via_upstream - "-" 0 29 73 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f1727d3b-1177-4527-9a58-0c61a626aed7" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.41:55434 10.133.0.41:443 10.132.0.9:39476 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T18:38:51.138903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:51.138936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:51.138950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:51.138956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T18:38:51.257549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:51.257587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:51.257604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:51.257612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T18:38:51.079Z] "GET /v1/api-keys/8152e745-ae00-427a-9460-dd10a9cebce6 HTTP/1.1" 200 - via_upstream - "-" 0 291 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "59ea9f61-40b1-4bd8-866b-2c4fd9314f13" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.41:55434 10.133.0.41:443 10.132.0.9:39484 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T18:38:51.193Z] "POST /v1/api-keys/bulk-revoke HTTP/1.1" 200 - via_upstream - "-" 57 125 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ce6fb256-404e-434b-baf6-d00e87d3cf22" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.41:55434 10.133.0.41:443 10.132.0.9:39498 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T18:38:53.233Z] "GET /maas-api/v1/me HTTP/1.1" 401 - - "-" 0 88 24 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "afc692d6-bf26-4d17-a170-7f1e90791f81" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.41:443 10.132.0.9:39502 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T18:38:53.807608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T18:38:53.807646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T18:38:53.807663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T18:38:53.807668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T18:38:54.018921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:54.018956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:54.018970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:38:54.018975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T18:38:53.727Z] "DELETE /v1/api-keys/8152e745-ae00-427a-9460-dd10a9cebce6 HTTP/1.1" 404 - via_upstream - "-" 0 29 79 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "24b25808-a31a-4a91-aea3-c900d340f433" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.41:55432 10.133.0.41:443 10.132.0.9:39504 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T18:38:53.952Z] "DELETE /v1/api-keys/bc622ad5-d2f1-4eca-9eb5-70605319c77c HTTP/1.1" 200 - via_upstream - "-" 0 335 66 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "d24573f2-bc83-48d8-9c79-6bc922bc5bfd" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.41:55434 10.133.0.41:443 10.132.0.9:39516 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T18:39:06.797788Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:39:10.235505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:39:26.573490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:39:36.842588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:39:46.923222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T18:39:50.305032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:39:50.305070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:39:50.305087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T18:39:50.305092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T18:39:50.197Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 107 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "312ab5a5-e67f-4047-9b53-21795866af38" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.41:55434 10.133.0.41:443 10.132.0.9:37882 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T18:39:51.588336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8