2026-11-04T01:54:15.128967Z info FLAG: --concurrency="0" 2026-11-04T01:54:15.128986Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:54:15.128992Z info FLAG: --help="false" 2026-11-04T01:54:15.128997Z info FLAG: --log_as_json="false" 2026-11-04T01:54:15.129000Z info FLAG: --log_caller="" 2026-11-04T01:54:15.129003Z info FLAG: --log_output_level="default:info" 2026-11-04T01:54:15.129006Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:54:15.129013Z info FLAG: --log_target="[stdout]" 2026-11-04T01:54:15.129017Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:54:15.129020Z info FLAG: --outlierLogPath="" 2026-11-04T01:54:15.129024Z info FLAG: --profiling="true" 2026-11-04T01:54:15.129028Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:54:15.129030Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:54:15.129032Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:54:15.129034Z info FLAG: --stsPort="0" 2026-11-04T01:54:15.129036Z info FLAG: --templateFile="" 2026-11-04T01:54:15.129039Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:54:15.129043Z info FLAG: --vklog="0" 2026-11-04T01:54:15.129047Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:54:15.129253Z info Proxy role ips=[10.133.0.43] type=router id=maas-default-gateway-openshift-default-84587756dc-sr6sb.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:54:15.129316Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:54:15.130850Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:54:15.131174Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:54:15.131187Z info JWT policy is third-party-jwt 2026-11-04T01:54:15.131190Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:54:15.133448Z info Starting default Istio SDS Server 2026-11-04T01:54:15.133484Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:54:15.133516Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:54:15.134069Z info Opening status port 15020 2026-11-04T01:54:15.135181Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:54:15.136252Z info sds Starting SDS grpc server 2026-11-04T01:54:15.136340Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:54:15.136943Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:54:15.137876Z info Starting proxy agent 2026-11-04T01:54:15.137906Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:54:15.213177Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:54:15.239904Z info cache generated new workload certificate resourceName=default latency=103.439231ms ttl=23h59m59.760101123s 2026-11-04T01:54:15.239956Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:54:15.240003Z info cache returned workload trust anchor from cache ttl=23h59m59.759999178s 2026-11-04T01:54:15.352079Z info ads ADS: new connection for node:1 2026-11-04T01:54:15.352159Z info cache returned workload certificate from cache ttl=23h59m59.647843668s 2026-11-04T01:54:15.353007Z info ads ADS: new connection for node:2 2026-11-04T01:54:15.353083Z info cache returned workload trust anchor from cache ttl=23h59m59.64691815s 2026-11-04T01:54:15.454609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:54:24.155346Z info Readiness succeeded in 9.029805362s 2026-11-04T01:54:24.155782Z info Envoy proxy is ready 2026-11-04T01:57:06.890369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:06.890411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:06.890428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:06.890435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:57:06.802Z] "DELETE /v1/api-keys/cc61478d-1eea-45e8-b708-c2b9199524ae HTTP/1.1" 200 - via_upstream - "-" 0 321 88 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5b4c8a28-7696-481f-ae17-126c7fbac7f3" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34406 10.133.0.43:443 10.132.0.14:47666 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:57:07.491787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:07.491830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:07.491846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:57:07.491852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:07.634795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:07.634831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:07.634844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:57:07.634848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:57:07.343Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 148 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "8002f9ef-a7f9-4c73-b6b5-7f6692cae214" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34408 10.133.0.43:443 10.132.0.14:47670 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:57:07.545Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 89 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "89094101-f8e7-4565-98fd-3c33ebae630b" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34408 10.133.0.43:443 10.132.0.14:47674 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:57:08.381822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:08.381866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:08.381883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:08.381889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:57:08.303Z] "DELETE /v1/api-keys/256b6988-1087-4f00-b134-f15cf7a08eb1 HTTP/1.1" 200 - via_upstream - "-" 0 321 78 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "9657fd32-fd6d-4df1-a94a-ae812ceb6545" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34408 10.133.0.43:443 10.132.0.14:47686 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:57:12.178054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:12.178088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:12.178120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:57:12.178125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:57:12.113Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 64 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "dfa26d08-e0fd-43a5-913f-bd7ca67830c6" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34408 10.133.0.43:443 10.132.0.14:47710 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:57:12.439345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:12.439374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:12.439385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:57:12.439390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:57:12.370Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 329 68 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0d7dc018-f7a2-4a7e-a07f-08ea5277904f" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34408 10.133.0.43:443 10.132.0.14:47716 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:57:13.664338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:13.664370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:13.664381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:13.664386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:57:13.587Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 76 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "ab65ad03-7e09-44ea-8fb4-7bf66e6b2f86" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34406 10.133.0.43:443 10.132.0.14:47938 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:57:16.672Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 85 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f5e31e3b-b934-4743-a263-3b77fa4aa0b3" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:45018 10.133.0.43:443 10.132.0.14:47944 - v1-completions-path 2026-11-04T01:58:15.786637Z info ads ADS: new connection for node:3 2026-11-04T01:58:15.807220Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T01:58:15.807286Z info cache read certificate from file resource=file-root:system 2026-11-04T01:58:17.468678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:58:24.010495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:58:59.610843Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:59:28.999228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:00:06.068605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:00:11.483829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:00:11.483868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:00:11.483883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T02:00:11.483889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:00:11.484119Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T02:00:11.336Z] "POST /anything/e2e-dft-a04838-539c3a HTTP/1.1" 200 - via_upstream - "-" 109 1596 147 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f7140cb7-cb63-475f-b74d-033963d3119d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.43:48798 10.133.0.43:443 10.132.0.14:42564 - llm.external-model-e2e-dft-a04838-cd34599f1693.0 2026-11-04T02:00:24.002305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:00:42.386405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:01:36.826503Z info ads ADS: "" 3 terminated with stream closed 2026-11-04T02:01:51.998401Z info ads ADS: new connection for node:4 2026-11-04T02:01:52.011449Z info cache read certificate from file resource=file-root:system 2026-11-04T02:01:53.394455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:02:00.446273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:02:19.157746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:02:19.183752Z info ads ADS: "" 4 terminated 2026-11-04T02:02:22.422926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:02:36.274684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9