2026-10-30T07:42:35.681890Z info FLAG: --concurrency="0" 2026-10-30T07:42:35.681927Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T07:42:35.681947Z info FLAG: --help="false" 2026-10-30T07:42:35.681951Z info FLAG: --log_as_json="false" 2026-10-30T07:42:35.681954Z info FLAG: --log_caller="" 2026-10-30T07:42:35.681957Z info FLAG: --log_output_level="default:info" 2026-10-30T07:42:35.681960Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T07:42:35.681967Z info FLAG: --log_target="[stdout]" 2026-10-30T07:42:35.681970Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T07:42:35.681974Z info FLAG: --outlierLogPath="" 2026-10-30T07:42:35.681977Z info FLAG: --profiling="true" 2026-10-30T07:42:35.681980Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T07:42:35.681983Z info FLAG: --proxyLogLevel="warning" 2026-10-30T07:42:35.681986Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T07:42:35.681989Z info FLAG: --stsPort="0" 2026-10-30T07:42:35.681992Z info FLAG: --templateFile="" 2026-10-30T07:42:35.681995Z info FLAG: --tokenManagerPlugin="" 2026-10-30T07:42:35.681999Z info FLAG: --vklog="0" 2026-10-30T07:42:35.682002Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T07:42:35.682190Z info Proxy role ips=[10.134.0.53] type=router id=maas-default-gateway-openshift-default-67bf986f99-rl2bc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T07:42:35.682262Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T07:42:35.683866Z info cpu limit detected as 2, setting concurrency 2026-10-30T07:42:35.684108Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T07:42:35.684119Z info JWT policy is third-party-jwt 2026-10-30T07:42:35.684122Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T07:42:35.685889Z info Starting default Istio SDS Server 2026-10-30T07:42:35.685918Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T07:42:35.685979Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T07:42:35.686408Z info Opening status port 15020 2026-10-30T07:42:35.687219Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T07:42:35.687893Z info sds Starting SDS grpc server 2026-10-30T07:42:35.687963Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T07:42:35.688802Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T07:42:35.689589Z info Starting proxy agent 2026-10-30T07:42:35.689617Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T07:42:35.754694Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T07:42:35.777499Z info cache generated new workload certificate resourceName=default latency=89.46443ms ttl=23h59m59.22250366s 2026-10-30T07:42:35.777530Z info cache Root cert has changed, start rotating root cert 2026-10-30T07:42:35.777562Z info cache returned workload trust anchor from cache ttl=23h59m59.222438284s 2026-10-30T07:42:35.879231Z info ads ADS: new connection for node:1 2026-10-30T07:42:35.879284Z info cache returned workload certificate from cache ttl=23h59m59.120718564s 2026-10-30T07:42:35.879594Z info ads ADS: new connection for node:2 2026-10-30T07:42:35.879679Z info cache returned workload trust anchor from cache ttl=23h59m59.120321576s 2026-10-30T07:42:35.968786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:42:43.737215Z info Readiness succeeded in 8.058388958s 2026-10-30T07:42:43.737639Z info Envoy proxy is ready 2026-10-30T07:43:05.315246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:21.538700Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T07:43:21.538724Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T07:43:21.538727Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T07:43:21.538731Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T07:43:21.456Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 81 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9a359c1b-7832-4855-90b1-daf6f449349d" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.53:443 10.132.0.11:60504 - v1-catch-all-path 2026-10-30T07:43:22.164703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:25.106513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:35.488151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:41.032402Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T07:43:40.954Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 78 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "b88ebb81-fb28-4501-b809-a2056e84cb73" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:33284 10.134.0.53:443 10.132.0.11:46586 - v1-catch-all-path 2026-10-30T07:43:53.562892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:43:55.921708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:44:10.614074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:44:21.661898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:44:24.163498Z info ads ADS: new connection for node:3 2026-10-30T07:44:24.163658Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:44:24.163688Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:44:28.081359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:45:06.618423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:45:12.299Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 330 89 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "4aaad3f2-71f1-4d87-86cf-a13990f81eec" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.61:8000" outbound|54321||e2e-prio-pool-74f9b463-inference-pool-ip-f42fb901.llm.svc.cluster.local 10.134.0.53:48484 10.134.0.53:443 10.132.0.11:38492 - v1-model-routing 2026-10-30T07:45:26.176824Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T07:45:26.255878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:45:28.562529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:45:31.430903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:45:36.819022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:13.125426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:29.706845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:45.435318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:57.447111Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:00.757000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:48:00.757036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:48:00.757051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:48:00.757056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:48:01.615400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:48:00.628Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 128 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "637ab1c9-78fa-438e-9fd7-28a2222eeb61" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.53:57692 10.134.0.53:443 10.132.0.11:42658 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:48:12.759654Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:17.179280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:23.448610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T07:48:23.387Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 77 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "7628d92c-fb54-4590-a73b-3ee9679c7b28" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:59274 10.134.0.53:443 10.132.0.11:42322 - v1-completions-path 2026-10-30T07:48:35.693556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:49:06.611Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 82 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9b3a8925-def7-4651-a32d-e4b078a676f2" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:47144 10.134.0.53:443 10.132.0.11:49990 - v1-completions-path 2026-10-30T07:49:26.407079Z info ads ADS: new connection for node:4 2026-10-30T07:49:26.411664Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T07:49:26.411709Z info cache read certificate from file resource=file-root:system 2026-10-30T07:49:27.576449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:30.114481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:39.241414Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"141","StreamId":"3698888191062218652"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-10-30T07:49:39.179Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 62 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "eaa8ad14-fb8b-4c62-9cfb-dcc16d7d8b3d" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.53:443 10.132.0.11:44862 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-30T07:49:43.852176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:49:43.852208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:49:43.852219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:49:43.852223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:49:43.852386Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:49:43.747Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1729 104 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "c13fc925-47c7-4b8e-8aa4-ed4cdf8156a8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.53:58386 10.134.0.53:443 10.132.0.11:42802 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:49:45.997831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:49:45.997859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:49:45.997867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:49:45.997872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:49:45.998114Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:49:45.873Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1728 125 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "84b04b8d-6d05-419f-abce-327c8dee7144" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.53:58398 10.134.0.53:443 10.132.0.11:42818 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:50:05.286772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:50:05.286812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:50:05.286828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:50:05.286833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:50:05.287047Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:50:05.189Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1724 97 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "63b1f015-28c2-401f-ae6b-7f3788785bc1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.53:58386 10.134.0.53:443 10.132.0.11:33102 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:50:07.408003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:50:07.408039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:50:07.408055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:50:07.408060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:50:07.408236Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:50:07.313Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1728 94 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "6b46aede-b9e2-403d-8138-c7cffb194987" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.53:58386 10.134.0.53:443 10.132.0.11:33128 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:50:55.155147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:55.275896Z info ads ADS: "" 4 terminated 2026-10-30T07:50:55.764242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:58.968850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:04.132190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:11.344163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T07:51:11.288Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 67 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "5158c0c5-e814-4b05-9876-f2d5a7208d6d" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:37914 10.134.0.53:443 10.132.0.11:45516 - v1-completions-path 2026-10-30T07:51:23.997605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:28.327720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:44.266709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:00.122746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:52:06.180Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "88c7f681-774f-41ce-a0a7-f347cbbd97d3" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:37914 10.134.0.53:443 10.132.0.11:34016 - v1-completions-path 2026-10-30T07:52:23.685207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:34.042416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:38.713146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:52:42.873Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "3d3b8317-5d39-43a5-8669-031e2793b1fb" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:59274 10.134.0.53:443 10.132.0.11:50032 - v1-completions-path [2026-10-30T07:52:43.373Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "3d7b1dfc-4abf-4d4b-95b0-6a9f19c6f9e1" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:37914 10.134.0.53:443 10.132.0.11:47440 - v1-completions-path 2026-10-30T07:52:55.698535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:57.990068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:05.031966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:53:05.032000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:53:05.032014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:53:05.032019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T07:53:04.940Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 91 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "94ec198f-5b2a-4cfd-8637-fad207725021" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.53:47970 10.134.0.53:443 10.132.0.11:42444 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:53:17.101399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:21.667799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:37.259403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:39.629824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:57.508801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:09.155250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:13.003623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:54:19.671Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 67 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "359c1218-c877-4dac-81e3-097947ae7785" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:38456 10.134.0.53:443 10.132.0.11:35528 - v1-completions-path 2026-10-30T07:54:41.275206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:59.425598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:55:09.769105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:11.563928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:15.244814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:46.438241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:02.340010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:04.744178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:23.696807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:36.082802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:39.462074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:59:43.065Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "ee93dd9a-d23a-411d-891b-503f775859d3" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:59274 10.134.0.53:443 10.132.0.11:42720 - v1-completions-path [2026-10-30T07:59:43.250Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "623ca0dc-0332-4d53-9598-8af86d86aa24" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:37914 10.134.0.53:443 10.132.0.11:42734 - v1-completions-path 2026-10-30T07:59:55.532608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:06.087574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:11.162962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:28.049055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:32.770110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:35.885210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T08:00:45.481Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 61 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "495544bd-ef58-4296-a8a4-7cde95edeeb5" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:37914 10.134.0.53:443 10.132.0.11:39466 - v1-completions-path [2026-10-30T08:00:45.666Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "4791c7de-7caa-4328-bf9a-a687aab02bc7" "maas.apps.59c8f9f7001e17a9d6fe.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.53:37914 10.134.0.53:443 10.132.0.11:39478 - v1-completions-path 2026-10-30T08:00:58.876528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:09.138780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:13.752197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:17.178475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:22.088365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:40.384456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:50.852760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:01:53.185295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:03.393547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:08.099851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:24.795994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:44.664732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:02:55.082493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:05.601838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:15.938407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:26.285489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:36.642055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:47.038568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:57.218782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:07.641811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:18.179618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8