2026-10-30T18:44:40.040370Z info FLAG: --concurrency="0" 2026-10-30T18:44:40.045683Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T18:44:40.045738Z info FLAG: --help="false" 2026-10-30T18:44:40.045764Z info FLAG: --log_as_json="false" 2026-10-30T18:44:40.045796Z info FLAG: --log_caller="" 2026-10-30T18:44:40.045819Z info FLAG: --log_output_level="default:info" 2026-10-30T18:44:40.045842Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T18:44:40.045870Z info FLAG: --log_target="[stdout]" 2026-10-30T18:44:40.045901Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T18:44:40.045923Z info FLAG: --outlierLogPath="" 2026-10-30T18:44:40.045945Z info FLAG: --profiling="true" 2026-10-30T18:44:40.045969Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T18:44:40.045991Z info FLAG: --proxyLogLevel="warning" 2026-10-30T18:44:40.046019Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T18:44:40.046041Z info FLAG: --stsPort="0" 2026-10-30T18:44:40.046063Z info FLAG: --templateFile="" 2026-10-30T18:44:40.046084Z info FLAG: --tokenManagerPlugin="" 2026-10-30T18:44:40.046108Z info FLAG: --vklog="0" 2026-10-30T18:44:40.046137Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T18:44:40.046376Z info Proxy role ips=[10.133.0.74] type=router id=maas-default-gateway-openshift-default-6dcf757899-wltdx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T18:44:40.047527Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T18:44:40.049473Z info cpu limit detected as 2, setting concurrency 2026-10-30T18:44:40.049887Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T18:44:40.049962Z info JWT policy is third-party-jwt 2026-10-30T18:44:40.049993Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T18:44:40.051869Z info Starting default Istio SDS Server 2026-10-30T18:44:40.052146Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T18:44:40.052204Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T18:44:40.051958Z info Opening status port 15020 2026-10-30T18:44:40.053673Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T18:44:40.057644Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T18:44:40.061013Z info Starting proxy agent 2026-10-30T18:44:40.061079Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T18:44:40.067896Z info sds Starting SDS grpc server 2026-10-30T18:44:40.067935Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T18:44:40.280051Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T18:44:40.321983Z info cache generated new workload certificate resourceName=default latency=254.360141ms ttl=23h59m59.678022677s 2026-10-30T18:44:40.322027Z info cache Root cert has changed, start rotating root cert 2026-10-30T18:44:40.322070Z info cache returned workload trust anchor from cache ttl=23h59m59.677930872s 2026-10-30T18:44:40.530300Z info ads ADS: new connection for node:1 2026-10-30T18:44:40.536931Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T18:44:40.536995Z info cache read certificate from file resource=file-root:system 2026-10-30T18:44:40.574069Z info ads ADS: new connection for node:2 2026-10-30T18:44:40.574141Z info cache returned workload certificate from cache ttl=23h59m59.425861382s 2026-10-30T18:44:40.575046Z info ads ADS: new connection for node:3 2026-10-30T18:44:40.575190Z info cache returned workload trust anchor from cache ttl=23h59m59.424811947s 2026-10-30T18:44:40.713926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:44:45.597468Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-10-30T18:44:49.509693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:44:50.496700Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T18:44:51.625277Z info Readiness succeeded in 11.589609138s 2026-10-30T18:44:51.625625Z info Envoy proxy is ready 2026-10-30T18:45:08.593985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:45:08.969Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 97 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "45f0766a-2549-4e44-8260-f9bff08cdaea" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.74:443 10.132.0.13:58926 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:45:17.035268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:45:20.143486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:20.143527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:20.143558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T18:45:20.143565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:20.143815Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-30T18:45:20.418749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:45:20.418789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:45:20.418804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:45:20.418810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:45:20.419038Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T18:45:20.020Z] "POST /anything/e2e-rt-eq-fccba7-client HTTP/1.1" 200 - via_upstream - "-" 124 1767 123 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "b9157733-0624-4205-b66e-929ede8355bf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.74:34966 10.133.0.74:443 10.132.0.13:60164 - llm.external-model-e2e-rt-eq-fccba7-bd2ccd20f88b.0 [2026-10-30T18:45:20.318Z] "POST /anything/e2e-rt-eq-fccba7-client HTTP/1.1" 200 - via_upstream - "-" 124 1771 100 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "aa110c0b-c346-45f0-9639-6d84f347e0cb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.74:34974 10.133.0.74:443 10.132.0.13:60180 - llm.external-model-e2e-rt-eq-fccba7-bd2ccd20f88b.0 2026-10-30T18:45:21.632506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:21.632559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:21.632573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:21.632578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T18:45:21.632809Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T18:45:21.531Z] "POST /anything/e2e-rt-eq-fccba7-client HTTP/1.1" 200 - via_upstream - "-" 124 1764 101 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "25e38eb1-1fc8-4a88-817f-df11f60bcd4d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.74:34966 10.133.0.74:443 10.132.0.13:43706 - llm.external-model-e2e-rt-eq-fccba7-bd2ccd20f88b.0 2026-10-30T18:45:21.921003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:45:21.921033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:45:21.921044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:45:21.921048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:45:21.921207Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T18:45:21.816Z] "POST /anything/e2e-rt-eq-fccba7-client HTTP/1.1" 200 - via_upstream - "-" 124 1761 104 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "4e6a73ed-74b7-4941-a786-506d1684ab25" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.74:34986 10.133.0.74:443 10.132.0.13:43722 - llm.external-model-e2e-rt-eq-fccba7-bd2ccd20f88b.0 2026-10-30T18:45:39.277981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:45:40.503Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 51 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "39825c7e-c52d-4ac6-b1dc-8e31f4dbc66e" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.74:443 10.132.0.13:36514 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T18:45:45.579Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 51 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "e7b8c934-1ffb-4993-b956-6e1919c45598" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.74:443 10.132.0.13:38248 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:45:47.159482Z info ads ADS: "" 1 terminated 2026-10-30T18:45:47.614081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:45:48.061Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 55 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "6db1f23b-627c-4a0f-9d1b-8ae03c24135d" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.74:443 10.132.0.13:38258 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:45:50.138080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:46:00.402610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9