2026-11-01T06:11:51.082168Z info FLAG: --concurrency="0" 2026-11-01T06:11:51.082199Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T06:11:51.082203Z info FLAG: --help="false" 2026-11-01T06:11:51.082205Z info FLAG: --log_as_json="false" 2026-11-01T06:11:51.082207Z info FLAG: --log_caller="" 2026-11-01T06:11:51.082210Z info FLAG: --log_output_level="default:info" 2026-11-01T06:11:51.082212Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T06:11:51.082218Z info FLAG: --log_target="[stdout]" 2026-11-01T06:11:51.082220Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T06:11:51.082222Z info FLAG: --outlierLogPath="" 2026-11-01T06:11:51.082224Z info FLAG: --profiling="true" 2026-11-01T06:11:51.082226Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T06:11:51.082228Z info FLAG: --proxyLogLevel="warning" 2026-11-01T06:11:51.082230Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T06:11:51.082232Z info FLAG: --stsPort="0" 2026-11-01T06:11:51.082234Z info FLAG: --templateFile="" 2026-11-01T06:11:51.082236Z info FLAG: --tokenManagerPlugin="" 2026-11-01T06:11:51.082239Z info FLAG: --vklog="0" 2026-11-01T06:11:51.082241Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T06:11:51.082374Z info Proxy role ips=[10.132.0.129] type=router id=maas-default-gateway-openshift-default-58d898bd55-xnxx8.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T06:11:51.082419Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T06:11:51.083497Z info cpu limit detected as 2, setting concurrency 2026-11-01T06:11:51.083700Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T06:11:51.083711Z info JWT policy is third-party-jwt 2026-11-01T06:11:51.083714Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T06:11:51.084988Z info Starting default Istio SDS Server 2026-11-01T06:11:51.085007Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T06:11:51.085023Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T06:11:51.085454Z info Opening status port 15020 2026-11-01T06:11:51.085884Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T06:11:51.086292Z info sds Starting SDS grpc server 2026-11-01T06:11:51.086308Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T06:11:51.088094Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T06:11:51.088959Z info Starting proxy agent 2026-11-01T06:11:51.088991Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T06:11:51.150266Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T06:11:51.296544Z info ads ADS: new connection for node:1 2026-11-01T06:11:51.296858Z info ads ADS: new connection for node:2 2026-11-01T06:11:51.349624Z info cache generated new workload certificate resourceName=default latency=262.920076ms ttl=23h59m59.650380879s 2026-11-01T06:11:51.349655Z info cache Root cert has changed, start rotating root cert 2026-11-01T06:11:51.349680Z info cache returned workload certificate from cache ttl=23h59m59.650322587s 2026-11-01T06:11:51.349687Z info cache returned workload trust anchor from cache ttl=23h59m59.650313623s 2026-11-01T06:11:51.349773Z info cache returned workload trust anchor from cache ttl=23h59m59.650227778s 2026-11-01T06:11:51.350117Z info cache returned workload trust anchor from cache ttl=23h59m59.649883498s 2026-11-01T06:11:51.433125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:11:59.359166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:00.304808Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T06:12:00.583316Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T06:12:01.313388Z info Readiness succeeded in 10.234153322s 2026-11-01T06:12:01.313680Z info Envoy proxy is ready 2026-11-01T06:12:02.762125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:12.532904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:26.118396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:35.285444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:51.860745Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:03.463943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:06.586434Z info ads ADS: new connection for node:3 2026-11-01T06:13:06.586747Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:06.586856Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:10.245526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:49.421715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:52.308523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:13:52.308563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:13:52.308577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:13:52.308583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T06:13:52.165Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 142 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "2c9bb899-3b1a-4aab-90ad-03a808a577a7" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.129:52584 10.132.0.129:443 10.132.0.14:43022 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:13:55.686Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 344 86 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "2217206d-5d18-4b7d-ba61-fadb3deb693c" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.1.64:8000" outbound|54321||e2e-prio-pool-25304531-inference-pool-ip-eb3771a1.llm.svc.cluster.local 10.132.0.129:37680 10.132.0.129:443 10.132.0.14:43034 - v1-model-routing 2026-11-01T06:14:13.313260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:13.332566Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T06:14:18.122247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:32.855448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:44.710140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:11.445258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:36.558168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:51.822524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:00.261287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:15.701021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:20.499768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:38.684713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:27.606720Z info ads ADS: new connection for node:4 2026-11-01T06:17:27.617892Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T06:17:27.617946Z info cache read certificate from file resource=file-root:system 2026-11-01T06:17:31.205142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:32.599048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:18:26.557690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:26.557728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:26.557739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:18:26.557744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:18:26.557956Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T06:18:26.429Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1707 128 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "7b518460-3c73-4ba3-9426-6dc314c88ea2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.129:51796 10.132.0.129:443 10.132.0.14:53968 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:18:38.184842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:38.184870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:38.184880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:18:38.184886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:38.185056Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T06:18:38.058Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 126 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "8eab79ec-6fe5-48d8-b439-544a01b72f04" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.129:40900 10.132.0.129:443 10.132.0.14:35532 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:19:03.763163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:19:03.763191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:19:03.763200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:19:03.763205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:19:03.763211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-01T06:19:03.763415Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T06:19:03.647Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 115 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "acd3c799-14ce-4657-950c-064dec47f6b4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.129:40900 10.132.0.129:443 10.132.0.14:33640 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:19:23.736633Z info ads ADS: "" 4 terminated 2026-11-01T06:19:23.777750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:26.340927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:36.567925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:19:39.363Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 79 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d6d70883-e6cd-4680-91b4-d47c650294a4" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:45646 - v1-completions-path 2026-11-01T06:19:54.866199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:11.773934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:20:22.364Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "5f4df6c9-3c54-4ad5-8d90-2d916fd5b6f9" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:37782 - v1-completions-path [2026-11-01T06:20:23.647Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d1ede243-e147-4c33-9d08-8ed75186d70e" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:37796 - v1-completions-path [2026-11-01T06:20:24.416Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c3b961a6-72af-470b-9154-b0ba031e4542" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:53238 10.132.0.129:443 10.132.0.14:37810 - v1-completions-path 2026-11-01T06:20:42.483683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:53.031302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:59.441344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:21:10.307Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 67 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e09964a6-9873-4fb0-860f-b3454712fccf" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:36980 - v1-completions-path [2026-11-01T06:21:10.586Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 67 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "94473a44-6d6f-4504-bc58-177154a3fd21" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:36986 - v1-completions-path [2026-11-01T06:21:11.375Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "2e7c76a8-91ab-42ba-8a4c-9401d032f642" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:36988 - v1-completions-path [2026-11-01T06:21:12.958Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "987f588c-dda3-44a5-b675-5ec2db495052" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:37010 - v1-completions-path [2026-11-01T06:21:14.031Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "18cadc5a-0668-4869-93d7-4f8c97040fc8" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:37020 - v1-completions-path 2026-11-01T06:21:28.085681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:32.648951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:45.935630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:55.903220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:19.603815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:30.188105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:48.178850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:54.319685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:12.503125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:17.913640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:29.219709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:55.969854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:06.662141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:54.871579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:25:02.481023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:16.530238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:45.026887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:04.546261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:09.509299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:21.328183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:38.115262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:43.030921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:46.806389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T06:29:46.742Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 69 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "31d94211-9d92-4b08-9c91-2b94be73b79f" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:53238 10.132.0.129:443 10.132.0.14:42578 - v1-completions-path [2026-11-01T06:29:47.462Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 64 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "29cedb72-a5bf-4d8e-917f-60bd34008ca9" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:53238 10.132.0.129:443 10.132.0.14:42590 - v1-completions-path 2026-11-01T06:30:02.733504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:13.376541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:19.924952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:32.220606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:30:32.220647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:30:32.220665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:30:32.220670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:30:32.100Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 119 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "1855a0f7-4adc-401f-80e5-4e37420fc8ff" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.132:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.129:54074 10.132.0.129:443 10.132.0.14:47568 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:30:33.644Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 68 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "4cd2e25a-c6b6-4756-a2c1-5399f9de002f" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:47588 - v1-completions-path 2026-11-01T06:30:48.843801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:55.315489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:01.243114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:31:14.151Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "ed493eb8-e49a-4f08-a81d-3ef7d744fff4" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:53238 10.132.0.129:443 10.132.0.14:35128 - v1-completions-path [2026-11-01T06:31:17.019Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "60818d76-782a-4777-93ed-60ae95cb96eb" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:54654 10.132.0.129:443 10.132.0.14:35144 - v1-completions-path [2026-11-01T06:31:18.805Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 69 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c23515c2-26d1-4d4d-9265-640e7361505d" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:53238 10.132.0.129:443 10.132.0.14:57502 - v1-completions-path 2026-11-01T06:31:33.389151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:44.113725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:50.705807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:56.542061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:08.564061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:32:16.720Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 74 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "1f4f14fa-2ba1-4dbb-bc73-60f46ce20662" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.129:53238 10.132.0.129:443 10.132.0.14:37354 - v1-completions-path 2026-11-01T06:32:18.647866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:32:18.647921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:32:18.647945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:32:18.647956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T06:32:18.500Z] "DELETE /v1/api-keys/edb8b60c-505a-4e14-99bd-c09b0f6d392b HTTP/1.1" 200 - via_upstream - "-" 0 367 147 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "0c580c27-c5fa-43c5-a6c5-c366532b8ab2" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.132:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.129:53122 10.132.0.129:443 10.132.0.14:44516 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:32:32.227215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:42.895707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:47.639507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:05.798215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:11.914899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:35.598294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:57.622419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:17.529489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:28.425859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:39.351164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:50.303929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:01.016812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:11.809517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:22.569585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:33.176118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8