2026-11-03T00:49:39.211389Z info FLAG: --concurrency="0" 2026-11-03T00:49:39.211408Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T00:49:39.211412Z info FLAG: --help="false" 2026-11-03T00:49:39.211414Z info FLAG: --log_as_json="false" 2026-11-03T00:49:39.211416Z info FLAG: --log_caller="" 2026-11-03T00:49:39.211418Z info FLAG: --log_output_level="default:info" 2026-11-03T00:49:39.211420Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T00:49:39.211425Z info FLAG: --log_target="[stdout]" 2026-11-03T00:49:39.211428Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T00:49:39.211430Z info FLAG: --outlierLogPath="" 2026-11-03T00:49:39.211432Z info FLAG: --profiling="true" 2026-11-03T00:49:39.211434Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T00:49:39.211436Z info FLAG: --proxyLogLevel="warning" 2026-11-03T00:49:39.211438Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T00:49:39.211440Z info FLAG: --stsPort="0" 2026-11-03T00:49:39.211442Z info FLAG: --templateFile="" 2026-11-03T00:49:39.211444Z info FLAG: --tokenManagerPlugin="" 2026-11-03T00:49:39.211446Z info FLAG: --vklog="0" 2026-11-03T00:49:39.211449Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T00:49:39.211594Z info Proxy role ips=[10.132.1.7] type=router id=maas-default-gateway-openshift-default-6cc458d887-cdvd9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T00:49:39.211643Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T00:49:39.213081Z info cpu limit detected as 2, setting concurrency 2026-11-03T00:49:39.213421Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T00:49:39.213439Z info JWT policy is third-party-jwt 2026-11-03T00:49:39.213442Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T00:49:39.214972Z info Starting default Istio SDS Server 2026-11-03T00:49:39.214989Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T00:49:39.215008Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T00:49:39.215623Z info Opening status port 15020 2026-11-03T00:49:39.216075Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T00:49:39.216590Z info sds Starting SDS grpc server 2026-11-03T00:49:39.216605Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T00:49:39.217579Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T00:49:39.218347Z info Starting proxy agent 2026-11-03T00:49:39.218377Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T00:49:39.265906Z info cache generated new workload certificate resourceName=default latency=49.176405ms ttl=23h59m59.73409678s 2026-11-03T00:49:39.265966Z info cache Root cert has changed, start rotating root cert 2026-11-03T00:49:39.265994Z info cache returned workload trust anchor from cache ttl=23h59m59.734005868s 2026-11-03T00:49:39.284628Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T00:49:39.504096Z info ads ADS: new connection for node:1 2026-11-03T00:49:39.509138Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T00:49:39.509189Z info cache read certificate from file resource=file-root:system 2026-11-03T00:49:39.538249Z info ads ADS: new connection for node:2 2026-11-03T00:49:39.538311Z info cache returned workload certificate from cache ttl=23h59m59.461691484s 2026-11-03T00:49:39.538897Z info ads ADS: new connection for node:3 2026-11-03T00:49:39.538995Z info cache returned workload trust anchor from cache ttl=23h59m59.461005851s 2026-11-03T00:49:39.674397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:49:48.642868Z info Readiness succeeded in 9.433635529s 2026-11-03T00:49:48.643261Z info Envoy proxy is ready 2026-11-03T00:49:48.769900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:50:27.574125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:51:06.482354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:51:44.805876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:52:04.458093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:52:26.195806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:55:15.926552Z info ads ADS: new connection for node:4 2026-11-03T00:55:15.926845Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:55:15.926879Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:57:03.568015Z info ads ADS: "" 4 terminated 2026-11-03T00:57:27.714365Z info ads ADS: "" 1 terminated with stream closed 2026-11-03T01:02:09.568766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:03:20.380285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:06:45.767508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:07:25.959401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:08:39.094167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:12:42.780021Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T01:18:36.606803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:18:36.606848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:18:36.606863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:18:36.606869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T01:18:36.490Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 116 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "d1426413-1490-4530-ad27-95510cde936f" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:47138 10.132.1.7:443 10.132.0.18:55416 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:18:39.615000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:18:42.240404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:18:42.240451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:18:42.240466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:18:42.240472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T01:18:42.140Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 99 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "da37478c-baef-49e1-9743-ae6b2d8724f1" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:47148 10.132.1.7:443 10.132.0.18:55434 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:19:02.724619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:19:37.150167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:19:39.717866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:19:39.717955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:19:39.717983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:19:39.717992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T01:19:39.544Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 303 173 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "966fb3f6-7534-43c1-aaf4-5205f2cd5750" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:47148 10.132.1.7:443 10.132.0.18:56504 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T01:19:40.123Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 173 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "5e98f2d2-58f6-46c2-b2b3-5c7759c9b22c" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:56946 10.132.1.7:443 10.132.0.18:56522 - v1-chat-completions-path 2026-11-03T01:19:52.966718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:19:55.397561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:01.476101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:08.436496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:18.602389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:21.427504Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T01:20:21.344Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 83 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "dca83023-da14-4774-af6a-e43cc9c5a3a8" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:37908 10.132.1.7:443 10.132.0.18:46134 - v1-catch-all-path 2026-11-03T01:20:33.438186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:44.479720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:47.193245Z info ads ADS: new connection for node:5 2026-11-03T01:20:47.193518Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:20:50.602289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:30.563894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:49.758743Z info ads ADS: "" 5 terminated 2026-11-03T01:21:49.822598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:52.176364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:54.917026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:22:00.108561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:24:16.711971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:24:32.770131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:24:49.000359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:02.958018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:06.075693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:25:06.075725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:25:06.075737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:25:06.075742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:25:06.766535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:25:06.014Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 60 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "d80a663b-d700-47a4-a174-e1d19507ccc0" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:56546 10.132.1.7:443 10.132.0.18:59924 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:25:17.991668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:22.661705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:25:25.763Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 77 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "ae818109-2674-4134-8e7f-6ac0838efa02" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:50228 - v1-completions-path 2026-11-03T01:25:38.019961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:54.796846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T01:25:54.737Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 77 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "11f5f48e-ec13-48c7-bca7-92868f5ff1cd" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:60472 10.132.1.7:443 10.132.0.18:42748 - v1-completions-path [2026-11-03T01:25:55.451Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 56 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "a169751c-fdf6-4945-8b6f-ad5c1fa5b0bb" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:60472 10.132.1.7:443 10.132.0.18:42762 - v1-completions-path 2026-11-03T01:26:24.710636Z info ads ADS: new connection for node:6 2026-11-03T01:26:24.719729Z info cache read certificate from file resource=file-root:system 2026-11-03T01:26:25.683905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:26:27.218575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:26:30.066553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:26:30.066598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:26:30.066620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:26:30.066627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T01:26:29.941Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 124 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "2a77202f-5b4a-9e86-a31c-f6381150607b" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:41604 10.132.1.7:443 10.132.0.18:43504 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:26:34.478467Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"621","StreamId":"10683790656930094956"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-03T01:26:34.422Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 56 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "77bd4906-a464-4fbf-8f3a-dc6c1f3b14eb" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.1.7:443 10.132.0.18:52156 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T01:26:38.698299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:26:38.698331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:26:38.698343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:26:38.698348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:26:38.698513Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T01:26:38.586Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 112 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "0918db7d-3dc9-4ac3-bca3-3130140c4f94" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.7:47674 10.132.1.7:443 10.132.0.18:52182 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:27:06.584648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T01:27:06.623324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:27:06.623352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:27:06.623365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:27:06.623369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:27:06.623548Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T01:27:06.522Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 101 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "c7fdf7d9-deb6-95cd-84e8-43c4b317803c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.7:47674 10.132.1.7:443 10.132.0.18:44312 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:28:02.817269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:28:02.923150Z info ads ADS: "" 6 terminated 2026-11-03T01:28:04.217176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:28:11.000511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:28:13.947Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "cf726c6f-013f-4f73-8975-d0cf426f1837" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:50386 - v1-completions-path [2026-11-03T01:28:14.129Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "0fb3a33b-d30c-417a-a7b4-1e1ad6bda68e" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:50394 - v1-completions-path [2026-11-03T01:28:14.564Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "382535a4-eaa5-41d5-8fbd-628224add5c4" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:50408 - v1-completions-path 2026-11-03T01:28:26.749902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:28:31.200475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:28:31.411Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 94 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "22dfbc4e-22d0-49cd-bcc7-1821457ea93d" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:33244 - v1-completions-path 2026-11-03T01:28:46.233293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:29:02.092213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:29:06.154894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:29:06.154957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:29:06.154975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:29:06.154980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T01:29:06.076Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 78 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "a1220b81-9fb6-476c-a370-f1f3bc27059b" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:46164 10.132.1.7:443 10.132.0.18:55696 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T01:29:07.465Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "2beb65cd-7d52-40ad-b959-d9c4db3da0d4" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:55704 - v1-completions-path [2026-11-03T01:29:07.735Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "927a44ea-8e88-4d1b-b627-e032979a3fef" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:55708 - v1-completions-path [2026-11-03T01:29:08.160Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 55 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "98e8ee58-0b14-4c5b-9963-804659bc818e" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:55724 - v1-completions-path [2026-11-03T01:29:08.311Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "1bcff0e5-5e20-4180-9771-8b247b56ca8f" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:55736 - v1-completions-path [2026-11-03T01:29:08.390Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 55 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "3670678e-39c7-4170-9d5e-955098236f8e" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:55740 - v1-completions-path [2026-11-03T01:29:08.464Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "e5f020d3-1865-401a-9a30-98c58c72433b" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:55752 - v1-completions-path 2026-11-03T01:29:24.617298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:29:48.448Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "f1eccafe-21a9-449e-adf0-f9b895208f47" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:60610 - v1-completions-path [2026-11-03T01:29:48.523Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 55 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "b7a63852-8b87-4d2c-9f27-f6a09837573a" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:60618 - v1-completions-path [2026-11-03T01:29:49.175Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 91 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "0b6ab096-f058-443d-b046-be163d7b0bf9" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:60634 - v1-completions-path 2026-11-03T01:30:11.552625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:20.831462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:25.940896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:30:31.916Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 65 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "82147109-44f4-4934-9e52-fd9732aed922" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:58954 10.132.1.7:443 10.132.0.18:33584 - v1-completions-path 2026-11-03T01:30:34.485013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:39.503189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:58.054081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:00.997964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:15.976878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:18.888675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:26.864873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:31:32.769Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 63 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "70cd3320-c8c5-40c9-a3cd-318a046d9878" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:38616 - v1-completions-path 2026-11-03T01:31:45.024515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:55.502830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:59.634833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:31:59.634872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:31:59.634888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:31:59.634894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T01:31:59.556Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 78 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "458fe971-f8ba-45bd-898d-49ae2dd6e219" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:47240 10.132.1.7:443 10.132.0.18:55852 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:32:12.398011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:32:14.974074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:34:33.493293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:34:36.818555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:02.441774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:18.094041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:20.426854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:27.593466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:45.223959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:48.999725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:36:52.137Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "ced5941a-0f42-4012-a836-8d044e4ce7c2" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:47604 - v1-completions-path 2026-11-03T01:37:04.629240Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:15.118118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:30.887170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:37:34.847Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 67 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "1f114445-5bf0-49b2-b352-9462561010fa" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:44430 - v1-completions-path [2026-11-03T01:37:34.938Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "7e47e396-3342-423c-8833-d1fc65c1097c" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:44434 - v1-completions-path [2026-11-03T01:37:35.381Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "4dcefe9c-d3e4-4a73-905a-9be4578064e7" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:44438 - v1-completions-path 2026-11-03T01:37:36.095873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:37:36.095934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:37:36.095954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:37:36.095959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T01:37:36.016Z] "DELETE /v1/api-keys/5bd93eb8-cd68-4ab9-89d5-fc45a1156fa5 HTTP/1.1" 200 - via_upstream - "-" 0 365 79 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "07abe926-4cd0-40dd-913a-4cc0945a05ff" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.1.79:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:34528 10.132.1.7:443 10.132.0.18:44444 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:37:48.032442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:52.599081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:55.683740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:02.049857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:02.049894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:02.049938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:02.049946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T01:38:01.975Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 310 74 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "9deb5483-8dfc-43a0-bff4-099629f1499c" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.1.79:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:34528 10.132.1.7:443 10.132.0.18:54088 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T01:38:04.780Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "d8c88ca2-c286-4f49-877e-ab6e6d3a79c9" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:43736 10.132.1.7:443 10.132.0.18:58042 - v1-completions-path 2026-11-03T01:38:18.896093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:29.154656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:33.692925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:37.309343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:40.026079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:40.026123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:40.026145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:40.026153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T01:38:39.937Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 89 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "d744129f-2b0f-4364-b9c0-4b9e460f5a14" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.1.71:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:45730 10.132.1.7:443 10.132.0.18:36032 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:38:42.089842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:48.658779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:48.658818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:48.658835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:38:48.658841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T01:38:47.682Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "f3109230-ea98-419e-b829-d6ea1ad95a97" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:34642 10.132.1.7:443 10.132.0.18:45762 - v1-completions-path [2026-11-03T01:38:48.516Z] "DELETE /v1/api-keys/c0b4dc0d-8561-4115-bc90-77c96f9e94ed HTTP/1.1" 200 - via_upstream - "-" 0 367 142 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "c3624090-df64-4cf3-96e8-24ebb459a03d" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.1.79:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.7:34528 10.132.1.7:443 10.132.0.18:45766 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:38:59.400578Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T01:39:00.617981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:11.075721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:13.432026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:22.842377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:26.548698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:44.122112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:46.462623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:04.819967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:15.115374Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:25.494678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:35.934630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:46.266737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:56.595380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:06.927736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:17.362015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:27.701146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:38.146220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:41:47.850Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 78 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "2a3c078c-908c-43cb-b767-bdf92a8be02b" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.7:58954 10.132.1.7:443 10.132.0.18:38752 - v1-completions-path