2026-11-02T02:55:23.980116Z info FLAG: --concurrency="0" 2026-11-02T02:55:23.980153Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T02:55:23.980159Z info FLAG: --help="false" 2026-11-02T02:55:23.980162Z info FLAG: --log_as_json="false" 2026-11-02T02:55:23.980165Z info FLAG: --log_caller="" 2026-11-02T02:55:23.980168Z info FLAG: --log_output_level="default:info" 2026-11-02T02:55:23.980172Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T02:55:23.980178Z info FLAG: --log_target="[stdout]" 2026-11-02T02:55:23.980182Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T02:55:23.980185Z info FLAG: --outlierLogPath="" 2026-11-02T02:55:23.980188Z info FLAG: --profiling="true" 2026-11-02T02:55:23.980191Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T02:55:23.980194Z info FLAG: --proxyLogLevel="warning" 2026-11-02T02:55:23.980198Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T02:55:23.980201Z info FLAG: --stsPort="0" 2026-11-02T02:55:23.980204Z info FLAG: --templateFile="" 2026-11-02T02:55:23.980207Z info FLAG: --tokenManagerPlugin="" 2026-11-02T02:55:23.980211Z info FLAG: --vklog="0" 2026-11-02T02:55:23.980215Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T02:55:23.980405Z info Proxy role ips=[10.132.1.137] type=router id=maas-default-gateway-openshift-default-769df7846c-h6lbp.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T02:55:23.980461Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T02:55:23.981587Z info cpu limit detected as 2, setting concurrency 2026-11-02T02:55:23.982077Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T02:55:23.982096Z info JWT policy is third-party-jwt 2026-11-02T02:55:23.982100Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T02:55:23.984533Z info Opening status port 15020 2026-11-02T02:55:23.984554Z info Starting default Istio SDS Server 2026-11-02T02:55:23.984575Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T02:55:23.984593Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T02:55:23.985340Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T02:55:23.986866Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T02:55:23.987838Z info Starting proxy agent 2026-11-02T02:55:23.987871Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T02:55:24.003100Z info sds Starting SDS grpc server 2026-11-02T02:55:24.003143Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T02:55:24.053363Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T02:55:24.205650Z info ads ADS: new connection for node:1 2026-11-02T02:55:24.206553Z info ads ADS: new connection for node:2 2026-11-02T02:55:24.278506Z info cache generated new workload certificate resourceName=default latency=293.013499ms ttl=23h59m59.721498355s 2026-11-02T02:55:24.278546Z info cache Root cert has changed, start rotating root cert 2026-11-02T02:55:24.278580Z info cache returned workload certificate from cache ttl=23h59m59.721424347s 2026-11-02T02:55:24.278598Z info cache returned workload trust anchor from cache ttl=23h59m59.721403166s 2026-11-02T02:55:24.278678Z info cache returned workload trust anchor from cache ttl=23h59m59.721322774s 2026-11-02T02:55:24.278980Z info cache returned workload trust anchor from cache ttl=23h59m59.721020905s 2026-11-02T02:55:24.381325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:55:32.557686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:55:33.513871Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T02:55:34.675204Z info Readiness succeeded in 10.698573863s 2026-11-02T02:55:34.675537Z info Envoy proxy is ready 2026-11-02T02:55:39.599641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:55:55.898866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:56:07.446038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:56:10.227620Z info ads ADS: new connection for node:3 2026-11-02T02:56:10.227865Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T02:56:10.227920Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T02:56:12.609330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:56:58.499570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:57:22.188566Z info ads ADS: "" 3 terminated 2026-11-02T02:57:22.480540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:57:27.155156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:57:43.542866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:00:28.021523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:00:28.021568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:00:28.021584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:00:28.021590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T03:00:27.880Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 140 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "a9e5d072-0818-4714-8ecf-43837bf280ab" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.137:51826 10.132.1.137:443 10.132.0.10:46280 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:00:36.596478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:01:04.815155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:01:30.279134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:01:45.851398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:01:59.540177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:02:12.172521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:02:17.121275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:02:36.320851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:03:23.645104Z info ads ADS: new connection for node:4 2026-11-02T03:03:23.650553Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T03:03:23.650601Z info cache read certificate from file resource=file-root:system 2026-11-02T03:03:26.832098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:03:29.480846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:03:34.669546Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"146","StreamId":"16247479127503840353"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-02T03:03:34.603Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 65 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "a78679b9-3cf4-4324-a5e2-808448924dd4" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.1.137:443 10.132.0.10:53478 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-02T03:04:42.845717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:04:42.845752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:04:42.845761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:04:42.845765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T03:04:42.845959Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T03:04:42.596Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 249 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "92b48c06-ce1b-402a-8050-6c6b9b3f47fa" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.137:37652 10.132.1.137:443 10.132.0.10:46070 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T03:05:07.248088Z info ads ADS: "" 4 terminated with stream closed 2026-11-02T03:05:07.299380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:05:07.614624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:05:07.614661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:05:07.614676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T03:05:07.614681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T03:05:07.494Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 120 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "037522c9-e788-4577-87b4-ade6c481110a" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.137:34148 10.132.1.137:443 10.132.0.10:51304 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:05:09.989645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:05:20.508659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:05:38.545562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:05:43.140255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T03:05:48.180Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 78 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "ed1e2996-a9ef-4761-9398-b2ed8a27cf62" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.137:39066 10.132.1.137:443 10.132.0.10:55090 - v1-completions-path 2026-11-02T03:06:03.296367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:06:21.822041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T03:06:34.243Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "0eb88e0e-5965-4317-913c-a14e644983e5" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.137:49020 10.132.1.137:443 10.132.0.10:43590 - v1-completions-path 2026-11-02T03:06:35.009802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T03:06:35.004Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e0e3112d-865d-421e-a7a3-7ec033c4bd7e" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.137:49020 10.132.1.137:443 10.132.0.10:43614 - v1-completions-path 2026-11-02T03:06:53.706580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:07:04.642505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:07:10.754363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:07:21.382526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:07:21.382570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:07:21.382590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T03:07:21.382597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T03:07:21.267Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 115 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f6d3e1e6-0e54-4d1a-8823-9da072349fbb" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.137:43112 10.132.1.137:443 10.132.0.10:60110 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:07:38.865942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:07:43.441040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:07:56.731480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:08:05.514964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:08:13.382645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:08:23.308285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:08:32.763432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:08:52.032904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:09:13.727327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:09:13.727369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:09:13.727385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:09:13.727391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T03:09:13.610Z] "DELETE /v1/api-keys/74cc8742-cc01-4407-8901-8b4187881800 HTTP/1.1" 200 - via_upstream - "-" 0 375 116 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "579b98a8-2596-4edb-911b-5227a910e2c3" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.137:54274 10.132.1.137:443 10.132.0.10:35846 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:09:23.022038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:09:45.761685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:09:56.542666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:14:15.792789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:14:35.550004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:14:40.202005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:14:53.210356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:15:09.491501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:15:14.780257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:15:20.980639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:15:20.980687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:15:20.980776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T03:15:20.980789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T03:15:20.864Z] "DELETE /v1/api-keys/667e52c6-2a0a-4cc3-92c3-884139d850f1 HTTP/1.1" 200 - via_upstream - "-" 0 369 116 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e18fc668-64d4-453a-8c84-2aaa3288fb1d" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.133.0.228:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.137:54128 10.132.1.137:443 10.132.0.10:36306 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:15:34.870904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:15:45.549896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:15:51.839027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T03:16:06.690Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "710669e1-dc15-4246-be0e-b3ecce0bf4c1" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.137:49020 10.132.1.137:443 10.132.0.10:57654 - v1-completions-path [2026-11-02T03:16:07.646Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "1b398ac4-751b-46c5-8f4b-b78b33237b79" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.137:49020 10.132.1.137:443 10.132.0.10:38072 - v1-completions-path 2026-11-02T03:16:21.845316Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:16:28.062288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:16:34.560833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T03:16:48.932Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 69 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "1411cb11-0336-4a88-84b1-c7844f634e45" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.137:49020 10.132.1.137:443 10.132.0.10:51060 - v1-completions-path [2026-11-02T03:16:49.292Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "c650dd99-3e6c-40a8-bdc4-44b6b7641cbe" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.137:39066 10.132.1.137:443 10.132.0.10:51062 - v1-completions-path 2026-11-02T03:17:06.233231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:17:17.227766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:17:23.835398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:17:30.080798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:17:41.693874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:17:49.942928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T03:17:49.936Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 67 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "75c462a2-d2ca-482b-8ce8-5ad70cf49c49" "maas.apps.82bac16f36aa9aea1c00.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.137:39066 10.132.1.137:443 10.132.0.10:54150 - v1-completions-path 2026-11-02T03:18:04.958085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:18:15.596758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:18:20.597017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:18:38.290375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:18:44.747361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:19:08.029216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:19:30.339414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:19:52.061161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:20:12.155924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:20:23.162819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:20:33.856765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:20:44.695601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:20:55.480667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T03:21:06.067506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9