2026-11-02T17:48:06.881220Z info FLAG: --concurrency="0" 2026-11-02T17:48:06.881248Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T17:48:06.881253Z info FLAG: --help="false" 2026-11-02T17:48:06.881255Z info FLAG: --log_as_json="false" 2026-11-02T17:48:06.881257Z info FLAG: --log_caller="" 2026-11-02T17:48:06.881259Z info FLAG: --log_output_level="default:info" 2026-11-02T17:48:06.881261Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T17:48:06.881266Z info FLAG: --log_target="[stdout]" 2026-11-02T17:48:06.881269Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T17:48:06.881271Z info FLAG: --outlierLogPath="" 2026-11-02T17:48:06.881273Z info FLAG: --profiling="true" 2026-11-02T17:48:06.881275Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T17:48:06.881277Z info FLAG: --proxyLogLevel="warning" 2026-11-02T17:48:06.881279Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T17:48:06.881281Z info FLAG: --stsPort="0" 2026-11-02T17:48:06.881283Z info FLAG: --templateFile="" 2026-11-02T17:48:06.881284Z info FLAG: --tokenManagerPlugin="" 2026-11-02T17:48:06.881287Z info FLAG: --vklog="0" 2026-11-02T17:48:06.881290Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T17:48:06.881494Z info Proxy role ips=[10.134.0.33] type=router id=maas-default-gateway-openshift-default-fcb75c45f-nc62c.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T17:48:06.881545Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T17:48:06.882648Z info cpu limit detected as 2, setting concurrency 2026-11-02T17:48:06.883238Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T17:48:06.883253Z info JWT policy is third-party-jwt 2026-11-02T17:48:06.883256Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T17:48:06.884975Z info Starting default Istio SDS Server 2026-11-02T17:48:06.885009Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T17:48:06.885031Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T17:48:06.885652Z info Opening status port 15020 2026-11-02T17:48:06.886155Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T17:48:06.886818Z info sds Starting SDS grpc server 2026-11-02T17:48:06.886834Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T17:48:06.887611Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T17:48:06.888489Z info Starting proxy agent 2026-11-02T17:48:06.888519Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T17:48:06.939752Z info cache generated new workload certificate resourceName=default latency=52.783262ms ttl=23h59m59.060252818s 2026-11-02T17:48:06.939784Z info cache Root cert has changed, start rotating root cert 2026-11-02T17:48:06.939819Z info cache returned workload trust anchor from cache ttl=23h59m59.06018191s 2026-11-02T17:48:06.952644Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T17:48:07.076482Z info ads ADS: new connection for node:1 2026-11-02T17:48:07.076560Z info cache returned workload certificate from cache ttl=23h59m58.923442529s 2026-11-02T17:48:07.076664Z info ads ADS: new connection for node:2 2026-11-02T17:48:07.076735Z info cache returned workload trust anchor from cache ttl=23h59m58.923266429s 2026-11-02T17:48:07.158198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:48:15.025274Z info Readiness succeeded in 8.146410558s 2026-11-02T17:48:15.025679Z info Envoy proxy is ready 2026-11-02T17:48:44.973376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:48:44.973409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:48:44.973428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:48:44.973433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T17:48:44.898Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 74 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "68ed914d-1e08-4067-852f-7e87475fb81a" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:49546 10.134.0.33:443 10.132.0.11:41414 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T17:48:45.878Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 57 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "501a605d-44c0-4a42-8a2f-954d4b6b87c9" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 10.132.0.11:41416 - v1-model-routing 2026-11-02T17:48:46.863667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:48:46.863699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:48:46.863711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T17:48:46.863716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T17:48:45.999Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "100ebf26-9af0-412f-9f47-b29c396d69a9" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 10.132.0.11:41428 - v1-model-routing [2026-11-02T17:48:46.113Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 57 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "08e13dd0-03e8-4b19-9b43-32dbe425381b" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 10.132.0.11:41442 - v1-model-routing [2026-11-02T17:48:46.804Z] "DELETE /v1/api-keys/b9fe965c-06f5-4979-973c-e8fb0f0578b7 HTTP/1.1" 200 - via_upstream - "-" 0 365 59 - "34.228.250.194,10.132.0.11" "curl/7.76.1" "1703515a-ef9b-4641-9f7d-6e27525a109e" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:49552 10.134.0.33:443 10.132.0.11:41450 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T17:51:11.525608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:11.525651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:11.525669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T17:51:11.525675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:11.746384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:51:11.746415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:51:11.746426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:51:11.746431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T17:51:12.030513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:51:12.030544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:51:12.030556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:51:12.030561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T17:51:11.448Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 77 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f0250b59-79fd-4178-891a-d4252afc6f87" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:59466 10.134.0.33:443 10.132.0.11:36612 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T17:51:11.677Z] "DELETE /v1/api-keys/94e9706e-eb25-46a1-a1d3-416771eb84df HTTP/1.1" 200 - via_upstream - "-" 0 370 68 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "c1ebf195-eeb6-4937-aef9-05e98a174b1d" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:59476 10.134.0.33:443 10.132.0.11:36622 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T17:51:11.972Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 57 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "2a15f1a3-ec48-4762-8ed8-610b7e075127" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:59476 10.134.0.33:443 10.132.0.11:36626 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T17:51:12.523962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:12.523992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:12.524003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:12.524008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T17:51:12.444Z] "DELETE /v1/api-keys/1fef45bc-c7d5-4de9-9788-1b913d4a8b69 HTTP/1.1" 200 - via_upstream - "-" 0 321 79 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "3bb7f01d-5597-4288-92ac-d8395be32636" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:59466 10.134.0.33:443 10.132.0.11:36630 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T17:51:13.268413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:13.268445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:13.268452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T17:51:13.268463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T17:51:13.268468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:13.544170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:51:13.544207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T17:51:13.544220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T17:51:13.544225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T17:51:13.210Z] "DELETE /v1/api-keys/27806eb5-09e2-477d-b45f-dc4913c97a9c HTTP/1.1" 200 - via_upstream - "-" 0 321 57 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f1baad7e-b95a-46eb-9cb3-6548655ad471" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:59466 10.134.0.33:443 10.132.0.11:36632 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T17:51:13.485Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 59 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "1115b16a-b412-499b-a33e-15945d0822d4" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:59476 10.134.0.33:443 10.132.0.11:38148 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T17:51:15.699568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:15.699605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T17:51:15.699623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T17:51:15.699630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T17:51:15.595Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 103 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "fd33dcb2-228f-4051-a5d1-21da1351b681" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.33:59466 10.134.0.33:443 10.132.0.11:38172 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T17:51:20.570Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 13 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9df54d1b-46cb-48df-aa83-a954267b4473" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.33:443 10.132.0.11:38188 - - [2026-11-02T17:51:20.722Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 7 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "b035425c-9c9d-4868-a6e5-e975e5a35ad3" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.33:443 10.132.0.11:38200 - - 2026-11-02T17:51:23.732073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:51:27.239827Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T17:51:27.239861Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T17:51:27.239866Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T17:51:27.239871Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T17:51:27.202Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 37 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "600edf92-eac4-424d-99db-94176fbe636c" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 10.132.0.11:54668 - v1-completions-path [2026-11-02T17:51:28.678Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 125 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "25855dae-1ac2-418f-8945-79e17fb55d0f" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:39956 10.134.0.33:443 10.132.0.11:54678 - v1-completions-path 2026-11-02T17:51:36.023985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:55:15.614759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:55:50.254731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:56:45.947906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T17:57:26.769239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:01:41.575009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:02:04.790529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:02:50.148752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:03:08.280671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:03:11.790327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:03:17.496Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "6f8abd82-f9c0-429e-b5cd-d49a21381398" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 10.132.0.11:43520 - v1-completions-path 2026-11-02T18:03:29.284966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:03:31.045642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:03:33.886275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:03:42.158413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:04:06.462830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:04:16.983444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:04:28.587779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:04:35.207Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "5ebb7c60-c789-4335-a694-ba3598afc2d5" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:38424 10.134.0.33:443 10.132.0.11:44000 - v1-completions-path [2026-11-02T18:04:35.344Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "bbea4340-c705-46a3-a455-b67a0db5382b" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:38424 10.134.0.33:443 10.132.0.11:44006 - v1-completions-path [2026-11-02T18:04:35.707Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "6398c936-6675-48e5-a54c-8a6b3aa078f9" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:38440 10.134.0.33:443 10.132.0.11:44014 - v1-completions-path 2026-11-02T18:04:36.223933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T18:04:36.168Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f30bc69d-9a7d-429d-a173-4d39d7fcd4af" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:38440 10.134.0.33:443 10.132.0.11:44032 - v1-completions-path 2026-11-02T18:04:47.778572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:04:49.607448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:05:06.242973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:05:08.538230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:05:25.023150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:05:26.870839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:05:42.916999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:05:53.480516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:05:56.490488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:06:15.139580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:06:17.248545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:06:20.649Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 73 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "cc591043-01f3-405f-8125-1d53ffb502d7" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:60302 10.134.0.33:443 10.132.0.11:39100 - v1-completions-path 2026-11-02T18:06:24.677138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:06:43.010231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:06:53.036846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:07:07.472Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 48 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "b7bf1283-0a10-4ef8-b5eb-2835b31f0391" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 10.132.0.11:34354 - v1-completions-path 2026-11-02T18:08:56.924968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:08:59.546717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:10:38.297418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:10:53.597364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:10:55.197561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:11:12.385205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:12:45.864008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:13:01.966947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:13:17.822658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:13:29.253829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:13:33.078861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:13:44.280813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:13:47.785354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T18:13:53.231Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 61 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "01c3a3e0-a822-4e01-bda3-c6d77f47900a" "maas.apps.df465f239a4f81e65420.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 10.132.0.11:59566 - v1-completions-path 2026-11-02T18:14:04.810760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:16:18.492603Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T18:17:03.539410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:17:08.947204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:17:24.399214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:17:25.989773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:17:40.581701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T18:17:51.397489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8