2026-10-30T12:45:07.561552Z info FLAG: --concurrency="0" 2026-10-30T12:45:07.561569Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T12:45:07.561573Z info FLAG: --help="false" 2026-10-30T12:45:07.561575Z info FLAG: --log_as_json="false" 2026-10-30T12:45:07.561577Z info FLAG: --log_caller="" 2026-10-30T12:45:07.561579Z info FLAG: --log_output_level="default:info" 2026-10-30T12:45:07.561581Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T12:45:07.561585Z info FLAG: --log_target="[stdout]" 2026-10-30T12:45:07.561587Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T12:45:07.561589Z info FLAG: --outlierLogPath="" 2026-10-30T12:45:07.561591Z info FLAG: --profiling="true" 2026-10-30T12:45:07.561593Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T12:45:07.561595Z info FLAG: --proxyLogLevel="warning" 2026-10-30T12:45:07.561597Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T12:45:07.561599Z info FLAG: --stsPort="0" 2026-10-30T12:45:07.561600Z info FLAG: --templateFile="" 2026-10-30T12:45:07.561602Z info FLAG: --tokenManagerPlugin="" 2026-10-30T12:45:07.561605Z info FLAG: --vklog="0" 2026-10-30T12:45:07.561607Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T12:45:07.561737Z info Proxy role ips=[10.133.0.39] type=router id=maas-default-gateway-openshift-default-fd4b99879-phfzv.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T12:45:07.561786Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T12:45:07.562705Z info cpu limit detected as 2, setting concurrency 2026-10-30T12:45:07.562906Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T12:45:07.562915Z info JWT policy is third-party-jwt 2026-10-30T12:45:07.562918Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T12:45:07.564920Z info Starting default Istio SDS Server 2026-10-30T12:45:07.564949Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T12:45:07.564980Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T12:45:07.565347Z info Opening status port 15020 2026-10-30T12:45:07.566244Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T12:45:07.567053Z info sds Starting SDS grpc server 2026-10-30T12:45:07.567069Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T12:45:07.567460Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T12:45:07.568208Z info Starting proxy agent 2026-10-30T12:45:07.568236Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T12:45:07.628515Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T12:45:07.741798Z info ads ADS: new connection for node:1 2026-10-30T12:45:07.742222Z info ads ADS: new connection for node:2 2026-10-30T12:45:07.776772Z info cache generated new workload certificate resourceName=default latency=209.584718ms ttl=23h59m59.223231535s 2026-10-30T12:45:07.776801Z info cache Root cert has changed, start rotating root cert 2026-10-30T12:45:07.776830Z info cache returned workload trust anchor from cache ttl=23h59m59.223170507s 2026-10-30T12:45:07.776857Z info cache returned workload certificate from cache ttl=23h59m59.223143427s 2026-10-30T12:45:07.776992Z info cache returned workload trust anchor from cache ttl=23h59m59.223009942s 2026-10-30T12:45:07.777158Z info cache returned workload trust anchor from cache ttl=23h59m59.222843184s 2026-10-30T12:45:07.853207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:45:15.403932Z info Readiness succeeded in 7.844381116s 2026-10-30T12:45:15.404353Z info Envoy proxy is ready [2026-10-30T12:45:56.635Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 342 78 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "549118e8-aadf-4c1b-8a7d-5cba8b4d3198" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:53840 10.133.0.39:443 10.132.0.12:50420 - v1-model-routing [2026-10-30T12:45:56.758Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 387 56 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "5ae4d1e5-f052-4955-8bd9-80989e138d39" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:53840 10.133.0.39:443 10.132.0.12:50436 - v1-model-routing 2026-10-30T12:49:46.377152Z info ads ADS: new connection for node:3 2026-10-30T12:49:46.382272Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T12:49:46.382320Z info cache read certificate from file resource=file-root:system 2026-10-30T12:49:47.844112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:49:53.226425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:50:08.448093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:50:09.120642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:50:09.120681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:50:09.120695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T12:50:09.120700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T12:50:09.006Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 114 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "0e812253-78f6-4f5b-ae95-6908601d9aaf" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:34884 10.133.0.39:443 10.132.0.12:53424 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T12:50:16.859555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:16.859589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:16.859599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:16.859603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T12:50:16.859760Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T12:50:16.790Z] "POST /llm/e2e-rt-sw-a3497b/anything/e2e-rt-sw-a3497b-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 68 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "151024a4-f515-4402-a9ed-55a5e91b182b" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-a3497b.llm.svc.cluster.local - 10.133.0.39:443 10.132.0.12:53446 - llm.external-model-e2e-rt-sw-a3497b-f5d953620960.2 2026-10-30T12:50:18.919582Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:50:33.667288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:33.667316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:33.667326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:33.667331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T12:50:33.667494Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T12:50:33.523Z] "POST /anything/e2e-rt-sw-a3497b-client HTTP/1.1" 200 - via_upstream - "-" 124 1769 144 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "e4385470-f091-44cf-a68f-175895d10baf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.39:37420 10.133.0.39:443 10.132.0.12:38742 - llm.external-model-e2e-rt-sw-a3497b-f5d953620960.0 2026-10-30T12:50:41.447968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:50:49.829472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:49.829502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:49.829512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T12:50:49.829516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:50:49.829651Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T12:50:49.769Z] "POST /llm/e2e-rt-sw-a3497b/anything/e2e-rt-sw-a3497b-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 60 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "5f9b088f-382a-40aa-8a5f-3f42ea654a50" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-a3497b.llm.svc.cluster.local - 10.133.0.39:443 10.132.0.12:58144 - llm.external-model-e2e-rt-sw-a3497b-f5d953620960.2 2026-10-30T12:51:09.841437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:51:25.232052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:51:28.749423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T12:51:28.750160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:51:28.750183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:51:28.750192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T12:51:28.750196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:51:28.750354Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T12:51:28.606Z] "POST /anything/e2e-rt-eq-dafa3a-client HTTP/1.1" 200 - via_upstream - "-" 124 1768 144 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "4be0c45a-3c34-4d49-9595-d2a57ddbcdb4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.39:43908 10.133.0.39:443 10.132.0.12:49974 - llm.external-model-e2e-rt-eq-dafa3a-52e6f1b2943d.2 2026-10-30T12:51:29.723973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:51:29.724005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:51:29.724017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T12:51:29.724021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T12:51:29.724189Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T12:51:29.626Z] "POST /anything/e2e-rt-eq-dafa3a-client HTTP/1.1" 200 - via_upstream - "-" 124 1768 98 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "0e82cc3c-6148-482f-a629-ee26b3fa1a65" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.39:43912 10.133.0.39:443 10.132.0.12:49980 - llm.external-model-e2e-rt-eq-dafa3a-52e6f1b2943d.0 2026-10-30T12:51:51.863014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:51:55.827600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:51:55.854651Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T12:52:09.169553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:53:05.798758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:53:30.219627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:53:55.211343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:55:41.851424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:29.053100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:57:29.053137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:57:29.053152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:57:29.053157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T12:57:28.957Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 95 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "3ac576be-bee6-4a72-b098-b6722f7ce6d6" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:37712 10.133.0.39:443 10.132.0.12:55048 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T12:57:30.448634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:57:30.448668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:57:30.448683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:57:30.448688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T12:57:30.370Z] "DELETE /v1/api-keys/f40b94a2-5c4d-4071-bdf6-7d8a742b6504 HTTP/1.1" 200 - via_upstream - "-" 0 321 78 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "8c3eeb19-e77d-48d2-b120-2b6e005cc717" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:37712 10.133.0.39:443 10.132.0.12:55056 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T12:57:46.122Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 67 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "854dd055-d95d-4285-a5f2-ba0865d1b721" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:53840 10.133.0.39:443 10.132.0.12:40726 - v1-completions-path [2026-10-30T12:57:46.922Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 6 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "6127ee58-a35e-4e33-ba49-285b758f1754" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.39:443 10.132.0.12:40730 - - 2026-10-30T13:04:56.282116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:04:56.282149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:04:56.282161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:04:56.282166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:04:56.428797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:04:56.428869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:04:56.428889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:04:56.428897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T13:04:56.262Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 19 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "9d5c549b-8bf5-4f5c-8f4c-86fb636dd780" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:59034 10.133.0.39:443 10.132.0.12:58560 - odh-ai-gateway-infra.maas-api-route.4 [2026-10-30T13:04:56.317Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 111 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "b2d677ed-1068-47b7-8f81-3a5838202030" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:32808 10.133.0.39:443 10.132.0.12:58568 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:04:56.792Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 337 131 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "582c5522-8371-49cb-8953-334e5c57b2b9" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:53840 10.133.0.39:443 10.132.0.12:58576 - v1-chat-completions-path 2026-10-30T13:05:39.955036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:05:39.955069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:05:39.955081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:05:39.955086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:05:39.955259Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-30T13:05:39.955314Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:05:39.955322Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:05:39.955325Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:05:39.955328Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T13:05:39.848Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 106 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "75d77364-5c41-475b-91fd-5f883582ecb6" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:60094 10.133.0.39:443 10.132.0.12:48940 - v1-chat-completions-path 2026-10-30T13:05:56.736667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:05:56.736705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:05:56.736721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:05:56.736726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T13:05:56.662Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 74 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "5b00fec8-a36c-4615-a164-eba2a2632b0f" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:49362 10.133.0.39:443 10.132.0.12:39104 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:16:37.424626Z info ads ADS: new connection for node:4 2026-10-30T13:16:37.454311Z info cache read certificate from file resource=file-root:system 2026-10-30T13:16:58.833484Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T13:23:17.752940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:23:44.052134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:23:44.837240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T13:23:44.853419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:23:44.853458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:23:44.853478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:23:44.853484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:23:44.763Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 90 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "dfd36a6d-34a7-4001-b2f5-12626b48695d" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:56198 10.133.0.39:443 10.132.0.12:43618 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:23:46.290Z] "POST /llm/e2e-dft-5a8a43/anything/e2e-dft-5a8a43-3427fb HTTP/1.1" 401 - - "-" 109 88 105 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "94c71c0b-be72-404f-a7e0-41fe141119fd" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-5a8a43.llm.svc.cluster.local - 10.133.0.39:443 10.132.0.12:43624 - llm.external-model-e2e-dft-5a8a43-ca4201435bdf.2 2026-10-30T13:23:59.185596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:01.975467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:09.277319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:24:26.844273Z info ads ADS: new connection for node:5 2026-10-30T13:24:26.844556Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T13:24:26.844660Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T13:24:44.316294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:28:10.926751Z info ads ADS: "" 5 terminated 2026-10-30T13:32:01.019929Z info ads ADS: "" 4 terminated with stream closed 2026-10-30T13:34:08.040980Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-30T13:36:16.499462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:37:04.962323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:39:32.999769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:41:11.097207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:42:11.261958Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T13:52:15.916200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:52:15.916243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:52:15.916262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:52:15.916269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:52:15.822Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 93 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "8278a09a-832f-4734-a657-00cd108fb2c5" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:42704 10.133.0.39:443 10.132.0.12:54440 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:52:19.518598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:52:42.915858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:14.810757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:53:20.729Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 72 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "31b0b867-eceb-49c1-9485-b4b7c8c9b67a" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:47604 10.133.0.39:443 10.132.0.12:58296 - v1-chat-completions-path 2026-10-30T13:53:33.110853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:36.105867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:46.144029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:04.218132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:06.616556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:09.667537Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T13:54:09.593Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "105c4c5f-61dc-40df-9240-1ea88a5907e9" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:58238 10.133.0.39:443 10.132.0.12:37262 - v1-catch-all-path 2026-10-30T13:54:21.720767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:32.522829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:34.535524Z info ads ADS: new connection for node:6 2026-10-30T13:54:34.535678Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T13:54:34.535707Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T13:54:36.386896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:16.770055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:19.641934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:55:19.642078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:55:19.642132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:55:19.642161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T13:55:17.598Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 2043 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "267a3cad-abd4-4dd6-be60-dc5e8a92b578" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:34656 10.133.0.39:443 10.132.0.12:37506 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:55:19.676Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 342 166 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "49196035-1847-42f7-a773-9530e6c37bf2" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.1.40:8000" outbound|54321||e2e-prio-pool-47dd2769-inference-pool-ip-de055579.llm.svc.cluster.local 10.133.0.39:55988 10.133.0.39:443 10.132.0.12:37512 - v1-model-routing [2026-10-30T13:55:23.303Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 335 61 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "f185a3fb-6c4e-4581-8519-2134757295dd" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.1.40:8000" outbound|54321||e2e-prio-pool-47dd2769-inference-pool-ip-de055579.llm.svc.cluster.local 10.133.0.39:55992 10.133.0.39:443 10.132.0.12:37526 - v1-model-routing 2026-10-30T13:55:35.794461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:35.941967Z info ads ADS: "" 6 terminated [2026-10-30T13:55:38.151Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 57 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "b7c59488-b3bc-45b2-9221-1b3345fbdee1" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:60094 10.133.0.39:443 10.132.0.12:56564 - v1-completions-path 2026-10-30T13:55:38.964111Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:46.803509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:22.931724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:39.223862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:54.229855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:08.250743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:12.104611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:23.819565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:27.811570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:34.122366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:58:34.122403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:58:34.122419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:58:34.122425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:58:33.703Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "29634846-d76f-47f2-81f8-46666ee64e72" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:43852 10.133.0.39:443 10.132.0.12:36942 - v1-completions-path [2026-10-30T13:58:34.070Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 51 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "26c012de-480b-4ef5-a302-72b600af2f5b" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:44266 10.133.0.39:443 10.132.0.12:36950 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:58:46.086958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:59:32.575176Z info ads ADS: new connection for node:7 2026-10-30T13:59:32.581261Z info cache read certificate from file resource=file-root:system 2026-10-30T13:59:33.547717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:59:35.385019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:59:44.662415Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"1219","StreamId":"10249982519040749370"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-10-30T13:59:44.600Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "004b9256-7fa0-4402-a2a5-1094bb09e453" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.39:443 10.132.0.12:39362 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-30T14:00:12.249002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:12.249036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:12.249048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T14:00:12.249052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:12.249207Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T14:00:12.136Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1724 113 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "9e5fcd0e-28a0-4d63-bcfc-b3a765f306e7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.39:46160 10.133.0.39:443 10.132.0.12:33044 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:00:16.488634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:16.488671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:16.488683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:16.488687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T14:00:16.488869Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T14:00:16.397Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 91 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c06b3dcd-407c-4675-8980-ac0b2efc7674" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.39:46160 10.133.0.39:443 10.132.0.12:33074 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:00:20.754473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:00:20.754509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:00:20.754521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:00:20.754525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:00:20.754687Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T14:00:20.648Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1724 105 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "bd94dbe8-1da3-4e2d-b61d-cc18570b3681" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.39:52846 10.133.0.39:443 10.132.0.12:48318 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:01:29.308031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:01:29.411683Z info ads ADS: "" 7 terminated with stream closed 2026-10-30T14:01:30.767079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:01:37.677255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:01:42.430Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "48721cbf-66ad-4add-b60c-7069744b18a4" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:43852 10.133.0.39:443 10.132.0.12:51918 - v1-completions-path 2026-10-30T14:01:54.651023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:01:59.153454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:17.517656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:33.468233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:02:46.168Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "db8c8840-6ad4-4305-83f3-90d9e118a8d7" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:33192 10.133.0.39:443 10.132.0.12:38860 - v1-completions-path 2026-10-30T14:03:02.438618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:12.838404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:17.341360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:03:24.652Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "4d878bc4-b96b-49f7-9355-d9ed655491d4" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:43852 10.133.0.39:443 10.132.0.12:56576 - v1-completions-path 2026-10-30T14:03:37.642059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:40.093987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:59.078601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:03.644119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:21.983226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:24.280693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:41.948722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:53.564125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:56.669734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:05:05.037770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:05:05.037805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:05:05.037821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:05:05.037826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T14:05:04.962Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 74 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "dcb99a42-ad16-428e-8043-323daf96e51e" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:41986 10.133.0.39:443 10.132.0.12:55848 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:05:17.090543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:05:19.379380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:05:25.918Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 67 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "f03dcc70-c9a5-490f-b708-d9c97a672e2a" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:60094 10.133.0.39:443 10.132.0.12:54162 - v1-completions-path 2026-10-30T14:05:32.947215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:05:38.372072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:05:38.372117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:05:38.372140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:05:38.372147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T14:05:38.296Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 75 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "fdce8e8b-f99b-4c70-aedf-7e782aa7000d" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:48470 10.133.0.39:443 10.132.0.12:59992 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:05:50.723592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:01.005275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:20.554926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:24.053260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:08:08.048340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:08:11.643897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:09:25.332579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:09:25.332618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:09:25.332634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:09:25.332639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T14:09:25.418780Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T14:09:25.418808Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T14:09:25.418810Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T14:09:25.418815Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T14:09:25.257Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 75 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "3f66fc63-6f62-4a18-9e34-b33fe70b3b19" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:35364 10.133.0.39:443 10.132.0.12:56836 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T14:09:25.366Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 52 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "7dca6154-1913-48fd-b56f-c452cb666f26" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.39:443 10.132.0.12:56846 - v1-completions-path 2026-10-30T14:09:46.241597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:09:48.926Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 290 135 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "182e5c04-9485-4b7a-b2d0-ee43082f6cec" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:38084 10.133.0.39:443 10.132.0.12:54362 - v1-completions-path 2026-10-30T14:10:01.768702Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:04.121067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:10:10.556Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 61 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "8f3830d0-8ae0-4e3d-a199-7692d019bc4d" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:52600 10.133.0.39:443 10.132.0.12:58170 - v1-completions-path 2026-10-30T14:10:22.787622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:34.498616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:37.793440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:10:38.542Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 108 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "b46b20a8-6a1e-45d3-8587-8874fd3ab45c" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:43852 10.133.0.39:443 10.132.0.12:43814 - v1-completions-path 2026-10-30T14:10:41.254635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:10:41.254671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:10:41.254687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:10:41.254692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T14:10:41.181Z] "DELETE /v1/api-keys/87e3d9f7-e4ea-453b-8d6b-c246df7bb78e HTTP/1.1" 200 - via_upstream - "-" 0 369 72 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "e71b8304-65e5-4c23-a684-0a85f85c0853" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.1.55:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:48576 10.133.0.39:443 10.132.0.12:43818 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:10:53.317465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:03.939733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:08.756407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:11:13.023Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 66 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "6bcd9d40-6bb1-49f7-a505-844955fa3979" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:33192 10.133.0.39:443 10.132.0.12:38890 - v1-completions-path 2026-10-30T14:11:13.866287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:11:13.866324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:11:13.866339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:11:13.866343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T14:11:13.792Z] "DELETE /v1/api-keys/685a9d20-6131-417b-a18b-bf0fe6057833 HTTP/1.1" 200 - via_upstream - "-" 0 365 74 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "3068a096-e4a8-4b7c-8724-c2ecb086cbe5" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.83:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.39:53576 10.133.0.39:443 10.132.0.12:38896 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:11:25.919753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:30.297876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:33.257338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:11:39.797Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "88754be3-9b1d-44a9-a6bc-3a99d841b84b" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:43852 10.133.0.39:443 10.132.0.12:43510 - v1-completions-path [2026-10-30T14:11:43.346Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "3e10d0f3-9d0e-4846-a57b-d5eaa67d104d" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:33192 10.133.0.39:443 10.132.0.12:43536 - v1-completions-path 2026-10-30T14:11:56.502340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:06.778449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:11.328160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:15.222539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:12:18.241Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "37f20229-af27-4c6a-b6e3-15ff0fab644d" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.39:33192 10.133.0.39:443 10.132.0.12:43682 - v1-completions-path 2026-10-30T14:12:20.343960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:48.625232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:58.885939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:01.070286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:11.791127Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-10-30T14:13:13.695588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:18.635728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:35.449205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:55.209399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:05.632641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:15.917006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:26.313654Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:36.618688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:47.035124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:57.315100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:15:07.686401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:15:17.981002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:15:28.323988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8