2026-11-04T01:55:21.185152Z info FLAG: --concurrency="0" 2026-11-04T01:55:21.185169Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:55:21.185174Z info FLAG: --help="false" 2026-11-04T01:55:21.185176Z info FLAG: --log_as_json="false" 2026-11-04T01:55:21.185178Z info FLAG: --log_caller="" 2026-11-04T01:55:21.185180Z info FLAG: --log_output_level="default:info" 2026-11-04T01:55:21.185183Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:55:21.185187Z info FLAG: --log_target="[stdout]" 2026-11-04T01:55:21.185189Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:55:21.185192Z info FLAG: --outlierLogPath="" 2026-11-04T01:55:21.185194Z info FLAG: --profiling="true" 2026-11-04T01:55:21.185196Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:55:21.185198Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:55:21.185199Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:55:21.185201Z info FLAG: --stsPort="0" 2026-11-04T01:55:21.185203Z info FLAG: --templateFile="" 2026-11-04T01:55:21.185205Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:55:21.185208Z info FLAG: --vklog="0" 2026-11-04T01:55:21.185210Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:55:21.185421Z info Proxy role ips=[10.133.0.34] type=router id=maas-default-gateway-openshift-default-58847f9fc5-bbrmp.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:55:21.185477Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:55:21.186732Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:55:21.186966Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:55:21.186977Z info JWT policy is third-party-jwt 2026-11-04T01:55:21.186980Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:55:21.188455Z info Starting default Istio SDS Server 2026-11-04T01:55:21.188482Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:55:21.188514Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:55:21.189041Z info Opening status port 15020 2026-11-04T01:55:21.189965Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:55:21.190726Z info sds Starting SDS grpc server 2026-11-04T01:55:21.190753Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:55:21.191389Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:55:21.192477Z info Starting proxy agent 2026-11-04T01:55:21.192538Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:55:21.264109Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:55:21.402240Z info ads ADS: new connection for node:1 2026-11-04T01:55:21.403056Z info ads ADS: new connection for node:2 2026-11-04T01:55:21.471399Z info cache generated new workload certificate resourceName=default latency=280.502238ms ttl=23h59m59.528606293s 2026-11-04T01:55:21.471431Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:55:21.471470Z info cache returned workload trust anchor from cache ttl=23h59m59.5285309s 2026-11-04T01:55:21.471480Z info cache returned workload certificate from cache ttl=23h59m59.528520021s 2026-11-04T01:55:21.471609Z info cache returned workload trust anchor from cache ttl=23h59m59.528395271s 2026-11-04T01:55:21.471852Z info cache returned workload trust anchor from cache ttl=23h59m59.528149021s 2026-11-04T01:55:21.553706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:29.710178Z info Readiness succeeded in 8.527743931s 2026-11-04T01:55:29.710480Z info Envoy proxy is ready [2026-11-04T01:55:36.441Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 104 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "33d007ce-f6bb-4af0-bec3-746e2759f5ab" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.15:59878 - v1-model-routing 2026-11-04T01:55:37.278381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:37.278415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:37.278427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:55:37.278432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:55:36.777Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 87 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "da7f90b2-8a74-4629-8d68-912aa11766fb" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.15:59892 - v1-model-routing [2026-11-04T01:55:37.005Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 81 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "82257196-a3b5-4717-af3e-0f617b22d0b4" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.15:59902 - v1-model-routing [2026-11-04T01:55:37.172Z] "DELETE /v1/api-keys/6bf84cd9-58f3-48c8-aaf6-7bdb8a6f2bf9 HTTP/1.1" 200 - via_upstream - "-" 0 365 105 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "4df5f5dc-5edc-4831-9a80-7f5f475785c2" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:55498 10.133.0.34:443 10.132.0.15:59914 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:58:05.885970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:05.886005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:05.886022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:58:05.886028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.690592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.690631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:58:06.690648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:58:06.690654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:58:05.800Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 85 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "b0f9dfd3-71d4-4b49-bcd0-332cf7e41924" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:50048 10.133.0.34:443 10.132.0.15:59468 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:06.441Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 49 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "cf193e5e-07dc-4cc8-8652-75b1a71b002a" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.34:443 10.132.0.15:59470 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:06.614Z] "DELETE /v1/api-keys/cdbc7d17-66ba-4b0e-97f3-5bfa2496f447 HTTP/1.1" 200 - via_upstream - "-" 0 321 76 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "291b79b2-ad60-4e7d-b4dc-1f120da36f65" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:50048 10.133.0.34:443 10.132.0.15:59476 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:58:10.191289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.191327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.191341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:58:10.191346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:58:10.121Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 69 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "b97077e3-4889-40b8-8ac5-e953a2991de2" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:49854 10.133.0.34:443 10.132.0.15:59494 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:58:11.808Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 48 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "a93a843a-49ed-464c-9d78-eb8dd99575c8" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.15:59510 - v1-completions-path 2026-11-04T01:59:12.642851Z info ads ADS: new connection for node:3 2026-11-04T01:59:12.647002Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T01:59:12.647461Z info cache read certificate from file resource=file-root:system 2026-11-04T01:59:13.440930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:31.668602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:37.218477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:59:37.218513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:59:37.218526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:59:37.218531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:59:36.936Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 281 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "8ea27267-98aa-4089-8b93-3bb51d163133" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:37578 10.133.0.34:443 10.132.0.15:41452 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:59:37.249Z] "POST /llm/e2e-dft-e168bb/anything/e2e-dft-e168bb-cd2527 HTTP/1.1" 404 - - "-" 109 0 27 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "116799b7-e1d8-4fc6-821e-f9a7e339e493" "maas.apps.b5b84be2b10d47dc01de.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-e168bb.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.15:41458 - llm.external-model-e2e-dft-e168bb-e52040f500bf.2 2026-11-04T02:00:21.938774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:01:06.142851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:01:27.570593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:01:32.475926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:02:26.068274Z info ads ADS: "" 3 terminated 2026-11-04T02:02:40.565905Z info ads ADS: new connection for node:4 2026-11-04T02:02:40.569089Z info cache read certificate from file resource=file-root:system 2026-11-04T02:02:41.978632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:02:50.708976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:03:15.436299Z info ads ADS: "" 4 terminated with stream closed 2026-11-04T02:03:15.502372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:03:15.794301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:03:26.961776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8