2026-10-30T13:45:49.799484Z info FLAG: --concurrency="0" 2026-10-30T13:45:49.799505Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T13:45:49.799509Z info FLAG: --help="false" 2026-10-30T13:45:49.799511Z info FLAG: --log_as_json="false" 2026-10-30T13:45:49.799513Z info FLAG: --log_caller="" 2026-10-30T13:45:49.799515Z info FLAG: --log_output_level="default:info" 2026-10-30T13:45:49.799517Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T13:45:49.799522Z info FLAG: --log_target="[stdout]" 2026-10-30T13:45:49.799525Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T13:45:49.799527Z info FLAG: --outlierLogPath="" 2026-10-30T13:45:49.799529Z info FLAG: --profiling="true" 2026-10-30T13:45:49.799533Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T13:45:49.799535Z info FLAG: --proxyLogLevel="warning" 2026-10-30T13:45:49.799538Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T13:45:49.799540Z info FLAG: --stsPort="0" 2026-10-30T13:45:49.799542Z info FLAG: --templateFile="" 2026-10-30T13:45:49.799544Z info FLAG: --tokenManagerPlugin="" 2026-10-30T13:45:49.799547Z info FLAG: --vklog="0" 2026-10-30T13:45:49.799549Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T13:45:49.799715Z info Proxy role ips=[10.133.1.98] type=router id=maas-default-gateway-openshift-default-58c6585447-52t9q.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T13:45:49.799767Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T13:45:49.800848Z info cpu limit detected as 2, setting concurrency 2026-10-30T13:45:49.801052Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T13:45:49.801064Z info JWT policy is third-party-jwt 2026-10-30T13:45:49.801067Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T13:45:49.802576Z info Opening status port 15020 2026-10-30T13:45:49.802588Z info Starting default Istio SDS Server 2026-10-30T13:45:49.802610Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T13:45:49.802629Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T13:45:49.803499Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T13:45:49.805390Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T13:45:49.807302Z info sds Starting SDS grpc server 2026-10-30T13:45:49.807322Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T13:45:49.807485Z info Starting proxy agent 2026-10-30T13:45:49.807511Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T13:45:49.872548Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T13:45:49.919674Z info cache generated new workload certificate resourceName=default latency=116.274474ms ttl=23h59m59.080331321s 2026-10-30T13:45:49.919715Z info cache Root cert has changed, start rotating root cert 2026-10-30T13:45:49.919751Z info cache returned workload trust anchor from cache ttl=23h59m59.080249629s 2026-10-30T13:45:49.990310Z info ads ADS: new connection for node:1 2026-10-30T13:45:49.990377Z info cache returned workload certificate from cache ttl=23h59m59.009624871s 2026-10-30T13:45:49.990792Z info ads ADS: new connection for node:2 2026-10-30T13:45:49.990876Z info cache returned workload trust anchor from cache ttl=23h59m59.009125087s 2026-10-30T13:45:50.072112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:58.568392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:59.512742Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T13:46:00.392878Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T13:46:00.536668Z info Readiness succeeded in 10.740265564s 2026-10-30T13:46:00.536972Z info Envoy proxy is ready 2026-10-30T13:46:03.610807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:08.002001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:46:12.805Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 83 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "2427ef6a-1ffc-4e8e-bb8e-b1dc6fd483c9" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.98:44778 10.133.1.98:443 10.132.0.16:54974 - v1-completions-path 2026-10-30T13:46:25.286725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:27.410268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:46:34.884Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 291 90 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "f0398d2f-e216-45bd-b405-b19263be3a90" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.133.1.98:36562 10.133.1.98:443 10.132.0.16:48240 - v1-completions-path 2026-10-30T13:46:46.823653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:51.707400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:47:05.628Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 76 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "7dd0170d-2d52-4bc3-8957-246700c06d3b" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.98:41972 10.133.1.98:443 10.132.0.16:53440 - v1-completions-path 2026-10-30T13:47:08.058966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:25.162134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:35.879378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:38.969777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:48:00.001101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:48:00.001142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:48:00.001156Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:48:00.001162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:47:59.922Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 78 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "9b663082-3255-4f95-b777-2cffb394b955" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.98:52284 10.133.1.98:443 10.132.0.16:38084 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:50:54.917187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T13:50:54.917305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:50:54.917332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:50:54.917349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:50:54.917356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:50:54.838Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 79 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "91939d08-e1e9-4909-b0e5-470c90e828f2" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.98:60550 10.133.1.98:443 10.132.0.16:54138 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:51:15.021051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:17.738116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:51:17.738161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:51:17.738185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:51:17.738193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:51:17.657Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 80 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "52b53170-7b56-424d-b92e-b3ba0267c7c3" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.98:50394 10.133.1.98:443 10.132.0.16:33972 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:51:29.646352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:31.951206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:46.445348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:01.806795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:53:01.806832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:53:01.806848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:53:01.806854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:53:01.732Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 74 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "76602962-73e1-4ced-82cc-aeae736b92ad" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.98:34662 10.133.1.98:443 10.132.0.16:36532 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:53:06.826581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:25.215044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:39.437547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:51.388445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:55.160506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:57.688597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:06.945891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:11.180600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:29.710466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:39.743571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:45.679678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T13:54:45.679993Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T13:54:45.557Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 122 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "efde568c-3b2a-48b1-81b3-d0369f2006f8" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.98:42934 10.133.1.98:443 10.132.0.16:59534 - v1-catch-all-path 2026-10-30T13:54:48.239755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:01.239034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:03.339972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:17.953121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:28.858727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8