2026-11-04T01:54:02.049283Z info FLAG: --concurrency="0" 2026-11-04T01:54:02.049302Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:54:02.049306Z info FLAG: --help="false" 2026-11-04T01:54:02.049308Z info FLAG: --log_as_json="false" 2026-11-04T01:54:02.049310Z info FLAG: --log_caller="" 2026-11-04T01:54:02.049312Z info FLAG: --log_output_level="default:info" 2026-11-04T01:54:02.049314Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:54:02.049318Z info FLAG: --log_target="[stdout]" 2026-11-04T01:54:02.049320Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:54:02.049322Z info FLAG: --outlierLogPath="" 2026-11-04T01:54:02.049324Z info FLAG: --profiling="true" 2026-11-04T01:54:02.049326Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:54:02.049328Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:54:02.049331Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:54:02.049332Z info FLAG: --stsPort="0" 2026-11-04T01:54:02.049334Z info FLAG: --templateFile="" 2026-11-04T01:54:02.049336Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:54:02.049338Z info FLAG: --vklog="0" 2026-11-04T01:54:02.049341Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:54:02.049487Z info Proxy role ips=[10.134.0.47] type=router id=maas-default-gateway-openshift-default-7f694df8bc-54x9n.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:54:02.049538Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:54:02.050615Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:54:02.050831Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:54:02.050843Z info JWT policy is third-party-jwt 2026-11-04T01:54:02.050847Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:54:02.052420Z info Starting default Istio SDS Server 2026-11-04T01:54:02.052451Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:54:02.052473Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:54:02.052916Z info Opening status port 15020 2026-11-04T01:54:02.053650Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:54:02.054276Z info sds Starting SDS grpc server 2026-11-04T01:54:02.054291Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:54:02.055178Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:54:02.056021Z info Starting proxy agent 2026-11-04T01:54:02.056051Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:54:02.098786Z info cache generated new workload certificate resourceName=default latency=44.385502ms ttl=23h59m59.901217586s 2026-11-04T01:54:02.098820Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:54:02.098849Z info cache returned workload trust anchor from cache ttl=23h59m59.901151958s 2026-11-04T01:54:02.120530Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:54:02.233138Z info ads ADS: new connection for node:1 2026-11-04T01:54:02.233198Z info cache returned workload certificate from cache ttl=23h59m59.766803744s 2026-11-04T01:54:02.233561Z info ads ADS: new connection for node:2 2026-11-04T01:54:02.233636Z info cache returned workload trust anchor from cache ttl=23h59m59.76636516s 2026-11-04T01:54:02.318019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:10.478745Z info Readiness succeeded in 8.432423062s 2026-11-04T01:54:10.479205Z info Envoy proxy is ready 2026-11-04T01:57:00.054541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T01:57:00.054583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T01:57:00.054596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T01:57:00.054629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-04T01:56:59.939Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 114 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "3786405f-982a-4f01-8c14-5579585217aa" "maas.apps.4a263ef06a303c77cb9a.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:36416 10.134.0.47:443 10.132.0.7:52504 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:57:00.092Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 44 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "a5ba14cb-645c-4b52-806e-2cfc3184050e" "maas.apps.4a263ef06a303c77cb9a.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.47:443 10.132.0.7:52510 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:57:02.296001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T01:57:02.296036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T01:57:02.296048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T01:57:02.296053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T01:57:02.401101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:02.401136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:02.401148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:57:02.401153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T01:57:02.225Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 70 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "4fa3ae94-9072-4b3b-af9e-9d2378c7bc32" "maas.apps.4a263ef06a303c77cb9a.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:36416 10.134.0.47:443 10.132.0.7:52518 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:57:02.306Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 94 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "176136d8-c14b-4193-8633-dcf8756e7b0c" "maas.apps.4a263ef06a303c77cb9a.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:36428 10.134.0.47:443 10.132.0.7:52526 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:57:03.552077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:03.552118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:57:03.552136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:57:03.552141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T01:57:03.482Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 70 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "fb0a4cd9-b604-4735-99af-2131897e519e" "maas.apps.4a263ef06a303c77cb9a.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:36428 10.134.0.47:443 10.132.0.7:52536 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:57:05.764Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 350 91 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "5efc2661-f904-43ea-8918-743cb8757876" "maas.apps.4a263ef06a303c77cb9a.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:36976 10.134.0.47:443 10.132.0.7:34310 - v1-chat-completions-path 2026-11-04T01:58:17.976422Z info ads ADS: new connection for node:3 2026-11-04T01:58:17.982174Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T01:58:17.982234Z info cache read certificate from file resource=file-root:system 2026-11-04T01:58:21.950348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:29.341501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:42.890260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:23.871003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:00:03.445529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:00:10.497Z] "POST /llm/e2e-dft-ed7fb3/anything/e2e-dft-ed7fb3-f96bc4 HTTP/1.1" 401 - - "-" 109 88 85 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "4c12ec61-b0e7-48b6-bc81-3b078327fa86" "maas.apps.4a263ef06a303c77cb9a.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-ed7fb3.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.7:45206 - llm.external-model-e2e-dft-ed7fb3-021d47143a91.2 2026-11-04T02:00:23.262713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:00:28.003943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:00:43.814570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:01:38.312012Z info ads ADS: "" 3 terminated with stream closed