2026-10-31T18:33:23.714636Z info FLAG: --concurrency="0" 2026-10-31T18:33:23.714654Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T18:33:23.714658Z info FLAG: --help="false" 2026-10-31T18:33:23.714661Z info FLAG: --log_as_json="false" 2026-10-31T18:33:23.714663Z info FLAG: --log_caller="" 2026-10-31T18:33:23.714665Z info FLAG: --log_output_level="default:info" 2026-10-31T18:33:23.714667Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T18:33:23.714672Z info FLAG: --log_target="[stdout]" 2026-10-31T18:33:23.714674Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T18:33:23.714676Z info FLAG: --outlierLogPath="" 2026-10-31T18:33:23.714678Z info FLAG: --profiling="true" 2026-10-31T18:33:23.714680Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T18:33:23.714682Z info FLAG: --proxyLogLevel="warning" 2026-10-31T18:33:23.714684Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T18:33:23.714686Z info FLAG: --stsPort="0" 2026-10-31T18:33:23.714688Z info FLAG: --templateFile="" 2026-10-31T18:33:23.714689Z info FLAG: --tokenManagerPlugin="" 2026-10-31T18:33:23.714692Z info FLAG: --vklog="0" 2026-10-31T18:33:23.714694Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T18:33:23.714840Z info Proxy role ips=[10.134.0.57] type=router id=maas-default-gateway-openshift-default-55fbd65575-pjmlx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T18:33:23.714888Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T18:33:23.715929Z info cpu limit detected as 2, setting concurrency 2026-10-31T18:33:23.716164Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T18:33:23.716176Z info JWT policy is third-party-jwt 2026-10-31T18:33:23.716179Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T18:33:23.717742Z info Starting default Istio SDS Server 2026-10-31T18:33:23.717772Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T18:33:23.717789Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T18:33:23.718155Z info Opening status port 15020 2026-10-31T18:33:23.719174Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T18:33:23.721475Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T18:33:23.722616Z info Starting proxy agent 2026-10-31T18:33:23.722657Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T18:33:23.730781Z info sds Starting SDS grpc server 2026-10-31T18:33:23.730802Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T18:33:23.785470Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T18:33:23.837303Z info cache generated new workload certificate resourceName=default latency=117.271935ms ttl=23h59m59.162700575s 2026-10-31T18:33:23.837335Z info cache Root cert has changed, start rotating root cert 2026-10-31T18:33:23.837364Z info cache returned workload trust anchor from cache ttl=23h59m59.162636802s 2026-10-31T18:33:23.902071Z info ads ADS: new connection for node:1 2026-10-31T18:33:23.902162Z info cache returned workload certificate from cache ttl=23h59m59.097840031s 2026-10-31T18:33:23.902344Z info ads ADS: new connection for node:2 2026-10-31T18:33:23.902414Z info cache returned workload trust anchor from cache ttl=23h59m59.097587212s 2026-10-31T18:33:24.004519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:33:33.423558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:33:34.311256Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:34.335082Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:35.347281Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:37.572673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:33:40.479273Z warn Envoy proxy is NOT ready: failed to get readiness stats: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(server\\.state|listener_manager\\.workers_started)": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:40.479365Z warn Envoy proxy is NOT ready: failed to get readiness stats: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(server\\.state|listener_manager\\.workers_started)": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T18:33:40.796930Z info Readiness succeeded in 17.08466957s 2026-10-31T18:33:40.797501Z info Envoy proxy is ready 2026-10-31T18:33:51.117379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:34:01.363630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:34:11.578308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:34:15.692150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:34:19.192324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:34:22.563648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:34:26.525179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:34:33.598968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T18:34:33.599003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T18:34:33.599014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T18:34:33.599019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T18:34:33.525Z] "GET /v1/model/grid-inv-c9819f68-model/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 2 73 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4c30fcc8-bc19-4a9c-a47d-0be356e67a90" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.57:60622 10.134.0.57:443 10.132.0.9:52258 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T18:36:43.217530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:36:50.173085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:36:54.496962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:37:10.632884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:37:20.886380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:37:31.061383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:37:35.757420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:37:39.737179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:38:12.244090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:38:22.318604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T18:38:22.318644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T18:38:22.318659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T18:38:22.318664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T18:38:22.239Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 328 79 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ea891170-e537-424f-bbbb-533e8fc5fc01" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.57:33484 10.134.0.57:443 10.132.0.9:57110 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T18:38:51.712989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T18:38:51.713020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T18:38:51.713032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T18:38:51.713037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T18:38:51.616Z] "POST /v1/api-keys/bulk-revoke HTTP/1.1" 403 - via_upstream - "-" 60 83 96 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "6c8bf044-1005-4fd5-89b2-0de311bb24bd" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.57:51818 10.134.0.57:443 10.132.0.9:39378 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T18:39:06.821255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:39:10.652830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:39:26.636880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:39:36.873799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:39:46.922513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T18:39:50.776865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T18:39:50.776970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T18:39:50.777016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T18:39:50.777044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T18:39:50.701Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 2 75 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9f7f8e1b-8075-4dd4-ae92-112bb173d1c2" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.57:51818 10.134.0.57:443 10.132.0.9:50202 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T18:39:51.612380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T18:40:11.601Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 42 0 42 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a9d6e58f-77b8-4466-929b-a2e38e539073" "maas.apps.8f20dad2ba3761f2a94b.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.57:443 10.132.0.9:39390 - odh-ai-gateway-infra.maas-api-route.3