2026-11-03T02:51:37.308751Z info FLAG: --concurrency="0" 2026-11-03T02:51:37.308775Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T02:51:37.308781Z info FLAG: --help="false" 2026-11-03T02:51:37.308785Z info FLAG: --log_as_json="false" 2026-11-03T02:51:37.308788Z info FLAG: --log_caller="" 2026-11-03T02:51:37.308791Z info FLAG: --log_output_level="default:info" 2026-11-03T02:51:37.308795Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T02:51:37.308802Z info FLAG: --log_target="[stdout]" 2026-11-03T02:51:37.308806Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T02:51:37.308809Z info FLAG: --outlierLogPath="" 2026-11-03T02:51:37.308812Z info FLAG: --profiling="true" 2026-11-03T02:51:37.308815Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T02:51:37.308818Z info FLAG: --proxyLogLevel="warning" 2026-11-03T02:51:37.308822Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T02:51:37.308825Z info FLAG: --stsPort="0" 2026-11-03T02:51:37.308828Z info FLAG: --templateFile="" 2026-11-03T02:51:37.308831Z info FLAG: --tokenManagerPlugin="" 2026-11-03T02:51:37.308835Z info FLAG: --vklog="0" 2026-11-03T02:51:37.308839Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T02:51:37.309013Z info Proxy role ips=[10.133.1.9] type=router id=maas-default-gateway-openshift-default-5bc884dd87-9bjwn.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T02:51:37.309071Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T02:51:37.310907Z info cpu limit detected as 2, setting concurrency 2026-11-03T02:51:37.311709Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T02:51:37.311743Z info JWT policy is third-party-jwt 2026-11-03T02:51:37.311748Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T02:51:37.314147Z info Starting default Istio SDS Server 2026-11-03T02:51:37.314165Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T02:51:37.314138Z info Opening status port 15020 2026-11-03T02:51:37.314183Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T02:51:37.314940Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T02:51:37.315803Z info sds Starting SDS grpc server 2026-11-03T02:51:37.315952Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T02:51:37.316913Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T02:51:37.318041Z info Starting proxy agent 2026-11-03T02:51:37.318081Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T02:51:37.397180Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T02:51:37.404415Z info cache generated new workload certificate resourceName=default latency=88.336999ms ttl=23h59m59.59558846s 2026-11-03T02:51:37.404495Z info cache Root cert has changed, start rotating root cert 2026-11-03T02:51:37.404557Z info cache returned workload trust anchor from cache ttl=23h59m59.595444243s 2026-11-03T02:51:37.676450Z info ads ADS: new connection for node:1 2026-11-03T02:51:37.683381Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T02:51:37.683431Z info cache read certificate from file resource=file-root:system 2026-11-03T02:51:37.716254Z info ads ADS: new connection for node:2 2026-11-03T02:51:37.716343Z info cache returned workload certificate from cache ttl=23h59m59.283659867s 2026-11-03T02:51:37.716870Z info ads ADS: new connection for node:3 2026-11-03T02:51:37.716940Z info cache returned workload trust anchor from cache ttl=23h59m59.283061223s 2026-11-03T02:51:37.831644Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:51:46.325259Z info Readiness succeeded in 9.01923469s 2026-11-03T02:51:46.325687Z info Envoy proxy is ready 2026-11-03T02:52:28.025102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:53:24.323656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:53:33.878327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:53:33.878369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:53:33.878388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T02:53:33.878394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T02:53:33.688Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 189 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "0de38b84-6a9b-41c6-a2e9-5ddeb0c6843e" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.9:41306 10.133.1.9:443 10.132.0.20:47180 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T02:53:34.072Z] "POST /llm/e2e-dft-fab300/anything/e2e-dft-fab300-102042 HTTP/1.1" 503 - - "-" 109 0 80 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "deb5eaad-7a76-40dc-856d-3c46afaba53c" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-fab300.llm.svc.cluster.local - 10.133.1.9:443 10.132.0.20:47186 - llm.external-model-e2e-dft-fab300-57d11ac65ad3.2 2026-11-03T02:54:22.536268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:55:02.618690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T02:56:41.938Z] "POST /llm/e2e-dft-fab300/anything/e2e-dft-fab300-102042 HTTP/1.1" 503 - - "-" 109 0 76 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2203b75b-5d7c-4bd8-ba63-0affd14d21c0" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-fab300.llm.svc.cluster.local - 10.133.1.9:443 10.132.0.20:37094 - llm.external-model-e2e-dft-fab300-57d11ac65ad3.2 [2026-11-03T02:57:24.507Z] "POST /llm/e2e-dft-fab300/anything/e2e-dft-fab300-102042 HTTP/1.1" 503 - - "-" 109 0 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ff7dd7f1-a01b-40fb-a5aa-73792cdd3193" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-fab300.llm.svc.cluster.local - 10.133.1.9:443 10.132.0.20:50374 - llm.external-model-e2e-dft-fab300-57d11ac65ad3.2 2026-11-03T02:58:21.411033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T02:58:24.388Z] "POST /llm/e2e-dft-fab300/anything/e2e-dft-fab300-102042 HTTP/1.1" 503 - - "-" 109 0 75 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "eb1a99ce-b6d2-4af3-b3d2-c3a1c1479207" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-fab300.llm.svc.cluster.local - 10.133.1.9:443 10.132.0.20:50050 - llm.external-model-e2e-dft-fab300-57d11ac65ad3.2 2026-11-03T02:58:47.906165Z info ads ADS: "" 1 terminated 2026-11-03T02:58:49.025324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:58:51.182735Z info ads ADS: new connection for node:4 2026-11-03T02:58:51.189524Z info cache read certificate from file resource=file-root:system 2026-11-03T02:58:55.421793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:58:56.951985Z info ads ADS: "" 4 terminated 2026-11-03T02:58:59.225358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:59:03.643940Z info ads ADS: new connection for node:5 2026-11-03T02:59:03.649482Z info cache read certificate from file resource=file-root:system 2026-11-03T02:59:07.925784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:59:09.830241Z info ads ADS: "" 5 terminated with stream closed 2026-11-03T02:59:13.995868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T02:59:29.344167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:01:07.064406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:01:48.461332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:03:02.872889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:16:12.812226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-03T03:16:12.812309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:16:12.812331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:16:12.812347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:16:12.812353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T03:16:12.644Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 168 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "9b4ed4ca-62c4-49da-98d5-57154a72425a" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.9:57012 10.133.1.9:443 10.132.0.20:41848 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:16:20.380431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:16:48.254515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:17:26.461096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:17:45.274277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:17:48.312116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:17:51.585997Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-03T03:17:51.498Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 87 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "8e1fae79-8a4a-4884-9bb4-d4732b5d50c2" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:46736 10.133.1.9:443 10.132.0.20:58550 - v1-catch-all-path 2026-11-03T03:17:52.019871Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T03:17:51.932Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 87 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "de1cfdd8-5280-45de-af36-c6bb105b1dc6" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:46742 10.133.1.9:443 10.132.0.20:58556 - v1-catch-all-path 2026-11-03T03:17:57.565538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:10.376116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:20.072343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:36.645229Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:48.405568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:53.008634Z info ads ADS: new connection for node:6 2026-11-03T03:18:53.008799Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T03:18:53.008823Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T03:18:57.394266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:19:40.019432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:19:46.547Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 338 96 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "65b44c4d-190c-4274-92cd-d9bfddc604d5" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.134.1.41:8000" outbound|54321||e2e-prio-pool-e934465c-inference-pool-ip-6641cb70.llm.svc.cluster.local 10.133.1.9:45850 10.133.1.9:443 10.132.0.20:59910 - v1-model-routing 2026-11-03T03:20:05.218485Z info ads ADS: "" 6 terminated 2026-11-03T03:20:05.282129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:20:11.366994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:20:27.052726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:20:46.434378Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T03:23:11.452619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:23:11.452654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:23:11.452666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:23:11.452672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T03:23:11.383Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 69 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1a9392a9-62de-47fc-b8f4-c944308b6953" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.9:41318 10.133.1.9:443 10.132.0.20:50864 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:23:23.055720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:23:47.511629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:11.560455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:24:11.560506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:24:11.560532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:24:11.560540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T03:24:11.503Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 56 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "5e058d85-7ead-413a-923b-9d29527a0986" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.9:36976 10.133.1.9:443 10.132.0.20:37950 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:24:13.571230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:28.865207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:37.092894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:49.965005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:54.542426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:24:58.760Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d6a86d71-7901-456a-a3bf-d70d343fea66" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.9:443 10.132.0.20:37806 - v1-completions-path 2026-11-03T03:25:12.609889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:25:59.392814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T03:25:59.329Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 83 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "86165ca3-e497-4e8b-a5b9-27b4f5f338a6" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:49368 10.133.1.9:443 10.132.0.20:44038 - v1-completions-path 2026-11-03T03:26:01.181430Z info ads ADS: new connection for node:7 2026-11-03T03:26:01.188016Z info cache read certificate from file resource=file-root:system 2026-11-03T03:26:05.037574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:26:06.023987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:26:13.667942Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"586","StreamId":"5390362481741882531"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=26 [2026-11-03T03:26:13.602Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 65 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a2405a1a-21b0-4599-8190-b48b56bff55c" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.1.9:443 10.132.0.20:34396 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T03:26:18.300912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:18.300955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:18.300970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:26:18.300976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:18.301161Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T03:26:18.105Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 196 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c4ac1952-9349-437c-8d44-9df453f3e572" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.9:49122 10.133.1.9:443 10.132.0.20:34416 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:26:23.222725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:23.222760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:23.222774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:23.222781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:26:23.222962Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T03:26:23.096Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 126 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "44c4a0a6-5355-4f90-9a91-b57dc35f5819" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.9:49122 10.133.1.9:443 10.132.0.20:46116 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:26:25.623445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:26:25.623477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:26:25.623487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:26:25.623491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:26:25.623636Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T03:26:25.431Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 191 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1156e383-cccc-437e-998e-b1bdde86c9d0" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.9:57274 10.133.1.9:443 10.132.0.20:46122 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:26:42.913061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:42.913091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:42.913100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:26:42.913105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:42.913289Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T03:26:42.783Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 129 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "130df964-238e-4972-8a1b-4d46fa443f3b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.9:49122 10.133.1.9:443 10.132.0.20:41082 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:26:54.839745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:54.839784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:54.839798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:26:54.839804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:26:54.840008Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T03:26:54.710Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 129 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7cb02ed1-7061-4262-9f6c-38cdda6d6f90" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.9:49122 10.133.1.9:443 10.132.0.20:41376 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:27:11.276365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:27:11.276402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:27:11.276416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:27:11.276423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:27:11.276611Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T03:27:11.147Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 129 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "404183cc-692e-451f-83ad-f181ff6e9531" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.9:49122 10.133.1.9:443 10.132.0.20:35088 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:27:13.594131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:13.594161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:13.594171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:27:13.594175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:13.594356Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T03:27:13.467Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 126 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1111aaea-c1d1-44f8-a30a-93cfe7a4e5be" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.9:57274 10.133.1.9:443 10.132.0.20:35092 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:27:34.795861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:27:34.795892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:27:34.795902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:27:34.795906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T03:27:34.796072Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T03:27:34.668Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 127 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7396e4dd-9a37-4ad7-984f-0ab1dd17c914" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.9:49122 10.133.1.9:443 10.132.0.20:60504 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:28:00.300012Z info ads ADS: "" 7 terminated 2026-11-03T03:28:00.343487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:02.823429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:13.127671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:31.626074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:35.980287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:55.745533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:29:12.664323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:29:21.902Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 70 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "52c3e80c-b05d-485e-a587-332d54e5cba7" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:48890 10.133.1.9:443 10.132.0.20:55296 - v1-completions-path [2026-11-03T03:29:26.619Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c7499fc1-8381-4159-847a-2e10fea52171" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:45578 10.133.1.9:443 10.132.0.20:55310 - v1-completions-path 2026-11-03T03:29:43.632799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:29:54.275666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:30:00.346949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:30:14.925Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e1796cd6-adc0-4e72-b7fd-1b396573ea60" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:48890 10.133.1.9:443 10.132.0.20:36154 - v1-completions-path 2026-11-03T03:30:30.328737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:30:34.939373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:30:47.576517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:30:56.208383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:31:05.187563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:31:13.993926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:31:22.904119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:31:41.082177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:32:01.959Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 67 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "095da7e6-ea21-4749-9b37-575fc5e04627" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:49368 10.133.1.9:443 10.132.0.20:49990 - v1-completions-path 2026-11-03T03:32:12.404317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:32:18.184981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:32:18.185015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:32:18.185031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T03:32:18.185036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T03:32:18.071Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 113 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a2466ada-0838-4cab-8220-028037fde31f" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.9:55024 10.133.1.9:443 10.132.0.20:40134 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:32:32.713441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:32:43.417142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:35:35.794699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:36:43.234379Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T03:36:43.234403Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T03:36:43.234406Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T03:36:43.234410Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-03T03:36:43.187Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 46 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7609b456-1d75-4915-a155-5be07751771c" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.9:443 10.132.0.20:46456 - v1-completions-path 2026-11-03T03:37:07.370626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:37:24.520595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:37:29.337431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:37:41.957258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:37:59.455065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:38:05.908173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:38:25.873969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:38:36.602149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:38:42.745078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:38:53.251777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:38:53.251811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:38:53.251830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:38:53.251835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T03:38:53.135Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 116 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1b5ddd27-3044-402b-9284-31e50f85336c" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.151:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.9:54344 10.133.1.9:443 10.132.0.20:56324 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:39:10.058271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:39:16.242767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:39:21.938543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:39:37.627352Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T03:39:52.960981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:03.815336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:10.168269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:15.995597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:26.266879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:40:33.104Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 67 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7ff3a9dc-7a25-42b5-a103-0d72b1118917" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:45578 10.133.1.9:443 10.132.0.20:45000 - v1-completions-path [2026-11-03T03:40:34.555Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "fc916b16-4b02-4772-bc11-126c7082ed6e" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.9:45578 10.133.1.9:443 10.132.0.20:45012 - v1-completions-path 2026-11-03T03:40:48.810925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:59.606714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:41:04.345070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:41:20.280475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:41:26.278112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:41:50.125462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:42:12.181046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:42:32.452717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:42:45.120375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:05.012056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:15.704758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:26.555435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:37.338693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:47.866592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:54.158875Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:43:54.158906Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:43:54.158910Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:43:54.158915Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T03:43:54.131Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 27 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e45c6cff-2982-4f48-9242-547b545f66dd" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.9:443 10.132.0.20:41426 - v1-completions-path