2026-11-03T00:19:41.416886Z info FLAG: --concurrency="0" 2026-11-03T00:19:41.416911Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T00:19:41.416915Z info FLAG: --help="false" 2026-11-03T00:19:41.416917Z info FLAG: --log_as_json="false" 2026-11-03T00:19:41.416919Z info FLAG: --log_caller="" 2026-11-03T00:19:41.416921Z info FLAG: --log_output_level="default:info" 2026-11-03T00:19:41.416923Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T00:19:41.416927Z info FLAG: --log_target="[stdout]" 2026-11-03T00:19:41.416929Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T00:19:41.416931Z info FLAG: --outlierLogPath="" 2026-11-03T00:19:41.416933Z info FLAG: --profiling="true" 2026-11-03T00:19:41.416935Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T00:19:41.416937Z info FLAG: --proxyLogLevel="warning" 2026-11-03T00:19:41.416939Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T00:19:41.416941Z info FLAG: --stsPort="0" 2026-11-03T00:19:41.416943Z info FLAG: --templateFile="" 2026-11-03T00:19:41.416945Z info FLAG: --tokenManagerPlugin="" 2026-11-03T00:19:41.416948Z info FLAG: --vklog="0" 2026-11-03T00:19:41.416950Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T00:19:41.417066Z info Proxy role ips=[10.133.1.53] type=router id=maas-default-gateway-openshift-default-694db55c87-6wkzh.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T00:19:41.417108Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T00:19:41.418080Z info cpu limit detected as 2, setting concurrency 2026-11-03T00:19:41.418277Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T00:19:41.418287Z info JWT policy is third-party-jwt 2026-11-03T00:19:41.418290Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T00:19:41.420114Z info Starting default Istio SDS Server 2026-11-03T00:19:41.420144Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T00:19:41.420185Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T00:19:41.421209Z info Opening status port 15020 2026-11-03T00:19:41.421552Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T00:19:41.422365Z info sds Starting SDS grpc server 2026-11-03T00:19:41.422467Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T00:19:41.423087Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T00:19:41.423824Z info Starting proxy agent 2026-11-03T00:19:41.423852Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T00:19:41.488149Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T00:19:41.642782Z info ads ADS: new connection for node:1 2026-11-03T00:19:41.642813Z info ads ADS: new connection for node:2 2026-11-03T00:19:41.680136Z info cache generated new workload certificate resourceName=default latency=257.510137ms ttl=23h59m59.319876678s 2026-11-03T00:19:41.680211Z info cache Root cert has changed, start rotating root cert 2026-11-03T00:19:41.680258Z info cache returned workload trust anchor from cache ttl=23h59m59.319742643s 2026-11-03T00:19:41.680285Z info cache returned workload certificate from cache ttl=23h59m59.319717734s 2026-11-03T00:19:41.680378Z info cache returned workload trust anchor from cache ttl=23h59m59.319624786s 2026-11-03T00:19:41.680766Z info cache returned workload trust anchor from cache ttl=23h59m59.319235737s 2026-11-03T00:19:41.763941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:19:49.855539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:19:50.920775Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T00:19:52.177761Z info Readiness succeeded in 10.764110044s 2026-11-03T00:19:52.178088Z info Envoy proxy is ready 2026-11-03T00:20:20.575506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:20:25.237Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 88 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "0a3a5d0c-b78e-4dbc-97e6-d50e05a5aef7" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:48604 10.133.1.53:443 10.132.0.17:42676 - v1-chat-completions-path 2026-11-03T00:20:40.375130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:20:45.296649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:20:47.746Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 28720 18 167 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "f8b51172-12b0-42f3-bd93-1d94eb2f62bb" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.53:443 10.132.0.17:52262 - v1-catch-all-path 2026-11-03T00:20:48.358613Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T00:20:48.267Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 91 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d453a893-5acd-4f37-87b6-2efd99540239" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:52668 10.133.1.53:443 10.132.0.17:52264 - v1-catch-all-path 2026-11-03T00:20:54.829750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:20:57.641006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:20:57.641042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:20:57.641057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:20:57.641062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:20:55.633Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 2007 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "526010ac-cf37-47b0-a9a2-eac5beae3bba" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.53:59536 10.133.1.53:443 10.132.0.17:54100 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:20:59.922731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T00:20:59.927464Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T00:20:59.838Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 89 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1a26c847-25ca-448c-9694-81ece72086bd" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:52668 10.133.1.53:443 10.132.0.17:38706 - v1-catch-all-path 2026-11-03T00:21:08.705151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:18.159228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:21.039615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:21:21.039750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:21:21.039784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:21:21.039791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:21:20.913Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 314 126 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "0e9a518d-9727-44b6-ac91-e1ad2b4af5f8" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.53:60180 10.133.1.53:443 10.132.0.17:54230 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:21:28.703343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:46.675366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:21:48.632631Z info ads ADS: new connection for node:3 2026-11-03T00:21:48.632963Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:21:48.633066Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:21:56.184811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:22:32.558846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:22:35.542829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:22:35.542875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:22:35.542897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:22:35.542904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:22:35.383Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 159 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "b035c9ff-9419-4e40-a78b-3c438d6d4ede" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.53:33912 10.133.1.53:443 10.132.0.17:38062 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T00:22:36.661Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 330 84 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "52f91cc2-5e24-4b7b-94d3-216c16589c1a" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.208:8000" outbound|54321||e2e-prio-pool-37a87c71-inference-pool-ip-ac6ea8b0.llm.svc.cluster.local 10.133.1.53:35390 10.133.1.53:443 10.132.0.17:38082 - v1-model-routing [2026-11-03T00:22:38.658Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 349 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "ea144c30-55c5-4996-a68c-dad0fc6bdff4" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.208:8000" outbound|54321||e2e-prio-pool-37a87c71-inference-pool-ip-ac6ea8b0.llm.svc.cluster.local 10.133.1.53:35390 10.133.1.53:443 10.132.0.17:38090 - v1-model-routing 2026-11-03T00:22:56.584556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:22:56.625570Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T00:23:01.427880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:23:01.273Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 99 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e9277720-774b-451e-bf9c-b2ec0e9aedaa" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:49742 10.133.1.53:443 10.132.0.17:42486 - v1-completions-path 2026-11-03T00:23:17.875132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:25:57.217433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:26:28.541063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:26:59.139157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:27:14.630279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:27:31.572222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:27:44.127274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:27:49.018830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:27:53.575Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 70 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "18786a49-7683-41e6-941b-8e84b009841c" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:52468 - v1-completions-path 2026-11-03T00:27:55.080048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T00:27:55.026Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "79356131-3df2-43c7-b11f-483597a9761e" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:52472 - v1-completions-path 2026-11-03T00:28:09.480417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:28:11.677851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:28:11.677890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:28:11.677906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:28:11.677911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:28:11.563Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 114 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "fe0921be-b7dc-49fe-a265-98a302edf8f2" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.53:33210 10.133.1.53:443 10.132.0.17:45610 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:28:56.863485Z info ads ADS: new connection for node:4 2026-11-03T00:28:56.870502Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T00:28:56.870553Z info cache read certificate from file resource=file-root:system 2026-11-03T00:29:00.787041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:29:02.003011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:29:09.581080Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"192","StreamId":"4785873875342731251"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-03T00:29:09.515Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 65 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "7eb49099-7aa2-48dc-949b-74ae16546029" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.1.53:443 10.132.0.17:56476 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T00:29:44.371622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:29:44.371655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:29:44.371665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:29:44.371669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:29:44.371817Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:29:44.247Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 124 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "6ec91aa6-3d85-45b6-9b6b-be977d80273f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.53:45444 10.133.1.53:443 10.132.0.17:36190 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:39.974486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:39.974520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:39.974533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:30:39.974537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:30:39.974714Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:30:39.861Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 113 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "07dba3fd-626c-425b-8243-128692f5cb88" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.53:45444 10.133.1.53:443 10.132.0.17:48074 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:30:57.545683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:30:57.573446Z info ads ADS: "" 4 terminated 2026-11-03T00:31:00.261473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:31:10.926599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:31:15.009Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 66 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e93d83ce-cbf2-4484-a5e1-0910cf698e47" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:41564 - v1-completions-path 2026-11-03T00:31:29.416363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:31:34.034776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:31:37.118Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 64 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "fee5ffad-c5be-4abc-9fb2-6f353c9b50e7" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:53538 10.133.1.53:443 10.132.0.17:40612 - v1-completions-path [2026-11-03T00:31:38.145Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 56 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "74d78d94-90c6-4f37-91bc-1459f7650443" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:40628 - v1-completions-path [2026-11-03T00:31:38.946Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "059464be-ac1d-4d42-8261-6bf5ff739d60" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:53538 10.133.1.53:443 10.132.0.17:42692 - v1-completions-path 2026-11-03T00:31:58.148786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:32:11.345061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:32:42.229621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:32:52.969727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:32:59.455779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:33:12.416Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "87084744-7226-4101-bd83-c37faeb6e761" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:53538 10.133.1.53:443 10.132.0.17:50126 - v1-completions-path [2026-11-03T00:33:12.936Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "9de7d619-e61f-4ad6-8d0d-cfcbb3a34369" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:50134 - v1-completions-path [2026-11-03T00:33:14.208Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 55 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "6d5e62c8-85de-4081-b433-fd4547fc9888" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:50136 - v1-completions-path 2026-11-03T00:33:27.776080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:33:32.353050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:33:45.712828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:33:52.292029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:06.772751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:11.447038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:24.980569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:38.372836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:34:41.237418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:34:41.237456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:34:41.237474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:34:41.237479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T00:34:41.117Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 120 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d603cd70-4cf9-48cc-b734-6d5e520979b1" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.53:50076 10.133.1.53:443 10.132.0.17:45342 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:34:44.383773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:02.764802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:08.438257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:19.887732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:31.801434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:35:31.801473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:35:31.801489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:35:31.801494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:35:31.682Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 118 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "e20df273-5401-4b2f-b0bf-5c75a540dc01" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.53:51410 10.133.1.53:443 10.132.0.17:59802 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:35:46.385486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:35:57.057127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:36:15.718493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:36:23.451529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:39:20.120440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:40:48.530597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:40:52.182396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:40:52.182430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:40:52.182442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:40:52.182447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:40:52.066Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 116 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "ee7fca48-a63b-4047-82ff-d9acaf94c3ce" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.134.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.53:58326 10.133.1.53:443 10.132.0.17:52090 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:41:05.916259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:10.698631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:24.073237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:39.842312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:41:44.758567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:41:50.000Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "50a01a62-1827-4e2a-a90a-547a80e2366f" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.53:443 10.132.0.17:54702 - v1-completions-path [2026-11-03T00:41:50.263Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "c2ab9ca3-0fab-43cf-8e10-0297634cb644" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:53538 10.133.1.53:443 10.132.0.17:54706 - v1-completions-path 2026-11-03T00:42:04.685677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:42:15.487823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:42:21.831741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:42:36.402Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "3646a223-0216-4920-80b4-c8f67f3ed7d1" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.53:443 10.132.0.17:42868 - v1-completions-path 2026-11-03T00:42:51.002455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:42:57.437995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:43:03.549467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:43:13.854Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "1e6a2871-43c3-4cf6-94d1-ea7aca4766ae" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:53538 10.133.1.53:443 10.132.0.17:40264 - v1-completions-path [2026-11-03T00:43:16.327Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "10fe3476-f396-457f-b87f-bbce11229570" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:53538 10.133.1.53:443 10.132.0.17:40268 - v1-completions-path [2026-11-03T00:43:18.836Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "bc3f4358-1039-48b1-aefa-fdf96dd1ed5b" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:48740 - v1-completions-path [2026-11-03T00:43:20.278Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "50e3e50c-bc2e-4fd7-95b8-8ab51ce600d4" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:48744 - v1-completions-path 2026-11-03T00:43:22.055530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:43:22.055571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:43:22.055588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:43:22.055592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:43:21.938Z] "DELETE /v1/api-keys/59ca17fd-4e83-452e-b962-7e9219efc39d HTTP/1.1" 200 - via_upstream - "-" 0 365 116 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "321d6288-e7b3-40ab-b4ce-53d715bfd01b" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.243:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.53:44554 10.133.1.53:443 10.132.0.17:48762 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:43:35.681583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:43:46.298852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:43:52.816210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:43:58.787149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:44:11.088195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:44:19.741Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "117923d2-c62a-47e3-a8fe-4918749e4694" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:54940 10.133.1.53:443 10.132.0.17:47220 - v1-completions-path 2026-11-03T00:44:34.512050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:44:45.120492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:44:50.000708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:08.387677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:15.377893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:24.784714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:45.114129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:45:57.792448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:46:17.949610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:46:28.979617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:46:39.927506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:46:50.586448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:47:01.367330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:47:12.155141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:47:22.919867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T00:47:33.549306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T00:47:39.094Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 82 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "479791c5-7c06-4cf9-a07d-1046f6cc17a2" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.53:49742 10.133.1.53:443 10.132.0.17:41198 - v1-completions-path [2026-11-03T00:47:40.269Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 40 - "44.212.242.249,10.132.0.17" "python-requests/2.34.2" "d5cd95ed-e8d9-4b6d-97fe-0027743e0169" "maas.apps.0f3a63f01c0b122488b1.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.53:443 10.132.0.17:41212 - v1-completions-path