2026-10-31T19:50:23.271423Z info FLAG: --concurrency="0" 2026-10-31T19:50:23.271448Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T19:50:23.271478Z info FLAG: --help="false" 2026-10-31T19:50:23.271483Z info FLAG: --log_as_json="false" 2026-10-31T19:50:23.271486Z info FLAG: --log_caller="" 2026-10-31T19:50:23.271489Z info FLAG: --log_output_level="default:info" 2026-10-31T19:50:23.271493Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T19:50:23.271500Z info FLAG: --log_target="[stdout]" 2026-10-31T19:50:23.271504Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T19:50:23.271507Z info FLAG: --outlierLogPath="" 2026-10-31T19:50:23.271511Z info FLAG: --profiling="true" 2026-10-31T19:50:23.271514Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T19:50:23.271517Z info FLAG: --proxyLogLevel="warning" 2026-10-31T19:50:23.271520Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T19:50:23.271524Z info FLAG: --stsPort="0" 2026-10-31T19:50:23.271527Z info FLAG: --templateFile="" 2026-10-31T19:50:23.271529Z info FLAG: --tokenManagerPlugin="" 2026-10-31T19:50:23.271534Z info FLAG: --vklog="0" 2026-10-31T19:50:23.271538Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T19:50:23.271778Z info Proxy role ips=[10.134.0.239] type=router id=maas-default-gateway-openshift-default-7f694df8bc-8z84d.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T19:50:23.271855Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T19:50:23.274821Z info cpu limit detected as 2, setting concurrency 2026-10-31T19:50:23.275165Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T19:50:23.275176Z info JWT policy is third-party-jwt 2026-10-31T19:50:23.275180Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T19:50:23.280253Z info Starting default Istio SDS Server 2026-10-31T19:50:23.280283Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T19:50:23.280319Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T19:50:23.280545Z info Opening status port 15020 2026-10-31T19:50:23.281984Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T19:50:23.284602Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T19:50:23.288512Z info sds Starting SDS grpc server 2026-10-31T19:50:23.288575Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T19:50:23.289409Z info Starting proxy agent 2026-10-31T19:50:23.298012Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T19:50:23.426923Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T19:50:23.505990Z info cache generated new workload certificate resourceName=default latency=219.379668ms ttl=23h59m59.494014814s 2026-10-31T19:50:23.506032Z info cache Root cert has changed, start rotating root cert 2026-10-31T19:50:23.506075Z info cache returned workload trust anchor from cache ttl=23h59m59.493926417s 2026-10-31T19:50:23.585759Z info ads ADS: new connection for node:1 2026-10-31T19:50:23.585862Z info cache returned workload certificate from cache ttl=23h59m59.414140308s 2026-10-31T19:50:23.586091Z info ads ADS: new connection for node:2 2026-10-31T19:50:23.586162Z info cache returned workload trust anchor from cache ttl=23h59m59.413840588s 2026-10-31T19:50:23.668618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:50:31.670243Z info Readiness succeeded in 8.402826908s 2026-10-31T19:50:31.670566Z info Envoy proxy is ready 2026-10-31T19:50:37.572003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:50:49.320312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:50:52.628746Z info ads ADS: new connection for node:3 2026-10-31T19:50:52.628925Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T19:50:52.628949Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T19:50:56.202757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:51:35.242566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:51:59.301275Z info ads ADS: "" 3 terminated with stream closed 2026-10-31T19:51:59.739010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:52:04.572913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:52:18.092891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:55:17.536921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:55:45.573833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:07.944572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:56:07.944607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:56:07.944623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T19:56:07.944628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T19:56:07.813Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 130 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "5cdc2442-7e42-4ea8-9056-1ed397418ed9" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.239:42502 10.134.0.239:443 10.132.0.17:44582 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T19:56:10.392668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:26.056412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:39.394424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:51.340243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:56.299248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T19:57:00.445Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 67 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "75c17402-b497-4376-a4c8-151f8e55ad02" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.239:443 10.132.0.17:44440 - v1-completions-path 2026-10-31T19:57:14.557431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:58:03.000292Z info ads ADS: new connection for node:4 2026-10-31T19:58:03.005527Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T19:58:03.005565Z info cache read certificate from file resource=file-root:system 2026-10-31T19:58:06.968934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:58:08.017297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:58:11.238115Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"139","StreamId":"2709879490587224620"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=26 [2026-10-31T19:58:11.177Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 60 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "95bc3e29-15e2-4470-ba94-6aa620d7247d" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.239:443 10.132.0.17:52458 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-31T19:58:34.471846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T19:58:34.471876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T19:58:34.471885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T19:58:34.471889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T19:58:34.472037Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-31T19:58:34.347Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 124 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "d65bbc12-c1d0-4805-b799-5eaaf8d631a0" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.239:59700 10.134.0.239:443 10.132.0.17:45582 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T19:58:48.487313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:58:48.487342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:58:48.487351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:58:48.487355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T19:58:48.487529Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T19:58:48.361Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 125 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "bac12344-27ef-49f1-a066-dddffb55a68f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.239:44270 10.134.0.239:443 10.132.0.17:35458 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T19:59:10.063877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T19:59:10.063909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T19:59:10.063920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T19:59:10.063925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T19:59:10.064064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-10-31T19:59:10.064098Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-31T19:59:09.942Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 121 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "96ebceb5-1616-405a-a4f4-11c90004619b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.239:59700 10.134.0.239:443 10.132.0.17:59150 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T19:59:37.931194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:37.931227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:37.931240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:37.931246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T19:59:37.931419Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T19:59:37.822Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 109 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "ce2ec06f-2476-4467-bfdc-e78e2e24a649" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.239:44270 10.134.0.239:443 10.132.0.17:59902 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T19:59:44.506548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:44.506576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-31T19:59:44.506593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:44.506613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:44.506618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T19:59:44.391Z] "DELETE /v1/api-keys/3921080a-a107-405e-99ee-8aec0c0e5889 HTTP/1.1" 200 - via_upstream - "-" 0 359 115 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "91466d07-7119-4815-ac45-a7eab10a32cd" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.239:53826 10.134.0.239:443 10.132.0.17:56226 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T19:59:57.768919Z info ads ADS: "" 4 terminated 2026-10-31T19:59:57.809695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:00:00.346179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:00:11.018974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:00:29.587913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:00:34.157373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:00:37.234Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 74 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "de15d2a0-b83c-4ec7-a341-f47e2d64a44b" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.239:60140 10.134.0.239:443 10.132.0.17:60252 - v1-completions-path 2026-10-31T20:00:55.093169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:01:12.001223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:01:42.879586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:01:53.495044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:01:59.809736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:02:12.501Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "06fe4a4f-2aef-490e-bf90-3c25c653b6db" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.239:53840 10.134.0.239:443 10.132.0.17:53548 - v1-completions-path [2026-10-31T20:02:14.055Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "d7881774-d139-43ae-8866-5bd3fca01b2d" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.239:53840 10.134.0.239:443 10.132.0.17:47102 - v1-completions-path [2026-10-31T20:02:14.567Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "83164905-4efb-4dc2-a7b5-5678893d276c" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.239:53840 10.134.0.239:443 10.132.0.17:47118 - v1-completions-path 2026-10-31T20:02:28.472040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:02:32.978080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:02:33.238709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T20:02:33.238761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T20:02:33.238787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T20:02:33.238794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-31T20:02:33.051Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 187 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "e6a730f2-786e-4205-8b82-6453dcc210f7" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.239:55302 10.134.0.239:443 10.132.0.17:37106 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T20:02:46.365052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:02:52.845820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:07.662484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:12.140597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:24.170947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:38.864676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:45.306810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:03.566715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:08.929877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:20.220241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:46.928416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:57.619961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:05:16.774279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:05:22.995396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:07:49.150686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:09:16.611730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:09:20.400494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:09:20.400530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:09:20.400547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:09:20.400554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T20:09:20.284Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 116 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3e67d4c0-0b2e-4fa8-8b39-55c9153efb37" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.239:40038 10.134.0.239:443 10.132.0.17:45000 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T20:09:34.035125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:09:39.053446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:09:39.530Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 143 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "c1d7dbd3-d214-467b-82c0-49bc91e8a65c" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.239:57702 10.134.0.239:443 10.132.0.17:38648 - v1-completions-path 2026-10-31T20:09:50.806551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:08.184321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:13.369406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:33.374588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:44.220981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:50.481053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:11:20.761902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:11:27.109159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:11:33.564764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:11:41.698929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T20:11:41.698969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T20:11:41.698984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T20:11:41.698990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-31T20:11:41.571Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 127 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "5e10416e-43c2-4d2f-b18a-ab1eb73c3162" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.255:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.239:43698 10.134.0.239:443 10.132.0.17:60846 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T20:11:49.185Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "ceab3398-d30b-443e-9c41-3c35bc2899d4" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.239:60140 10.134.0.239:443 10.132.0.17:46608 - v1-completions-path 2026-10-31T20:12:05.647898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:12:16.317292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:12:23.140104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:12:29.162860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:12:41.165247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:04.750105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:15.344190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:20.197576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:38.516731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:45.056980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:14:08.658503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:14:30.902210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:14:50.874594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:01.865305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:13.016411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:23.667016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:34.504847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:45.425406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:56.117741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:16:06.730536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:16:17.552Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 83 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "00b8dbea-570c-4527-9503-20b4d2a849a7" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.239:57702 10.134.0.239:443 10.132.0.17:57986 - v1-completions-path