2026-10-31T04:18:17.888539Z info FLAG: --concurrency="0" 2026-10-31T04:18:17.888560Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T04:18:17.888564Z info FLAG: --help="false" 2026-10-31T04:18:17.888567Z info FLAG: --log_as_json="false" 2026-10-31T04:18:17.888569Z info FLAG: --log_caller="" 2026-10-31T04:18:17.888571Z info FLAG: --log_output_level="default:info" 2026-10-31T04:18:17.888574Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T04:18:17.888579Z info FLAG: --log_target="[stdout]" 2026-10-31T04:18:17.888581Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T04:18:17.888583Z info FLAG: --outlierLogPath="" 2026-10-31T04:18:17.888585Z info FLAG: --profiling="true" 2026-10-31T04:18:17.888589Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T04:18:17.888591Z info FLAG: --proxyLogLevel="warning" 2026-10-31T04:18:17.888593Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T04:18:17.888595Z info FLAG: --stsPort="0" 2026-10-31T04:18:17.888597Z info FLAG: --templateFile="" 2026-10-31T04:18:17.888599Z info FLAG: --tokenManagerPlugin="" 2026-10-31T04:18:17.888601Z info FLAG: --vklog="0" 2026-10-31T04:18:17.888604Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T04:18:17.888760Z info Proxy role ips=[10.134.0.144] type=router id=maas-default-gateway-openshift-default-6886b96f9-bwzrc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T04:18:17.888812Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T04:18:17.890633Z info cpu limit detected as 2, setting concurrency 2026-10-31T04:18:17.890971Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T04:18:17.890984Z info JWT policy is third-party-jwt 2026-10-31T04:18:17.890988Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T04:18:17.893391Z info Starting default Istio SDS Server 2026-10-31T04:18:17.893379Z info Opening status port 15020 2026-10-31T04:18:17.893423Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T04:18:17.893442Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T04:18:17.894132Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T04:18:17.895631Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T04:18:17.896577Z info Starting proxy agent 2026-10-31T04:18:17.896613Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T04:18:17.903921Z info sds Starting SDS grpc server 2026-10-31T04:18:17.903946Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T04:18:17.972452Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T04:18:18.062047Z info cache generated new workload certificate resourceName=default latency=167.695227ms ttl=23h59m59.937961038s 2026-10-31T04:18:18.062098Z info cache Root cert has changed, start rotating root cert 2026-10-31T04:18:18.062142Z info cache returned workload trust anchor from cache ttl=23h59m59.937860144s 2026-10-31T04:18:18.214616Z info ads ADS: new connection for node:1 2026-10-31T04:18:18.214687Z info cache returned workload certificate from cache ttl=23h59m59.785314841s 2026-10-31T04:18:18.215319Z info ads ADS: new connection for node:2 2026-10-31T04:18:18.215423Z info cache returned workload trust anchor from cache ttl=23h59m59.784579137s 2026-10-31T04:18:18.317641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:18:26.515968Z info Readiness succeeded in 8.629938323s 2026-10-31T04:18:26.516376Z info Envoy proxy is ready 2026-10-31T04:19:31.619597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:19:59.731408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:21:39.687286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:30:29.577971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:30:29.578010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:30:29.578025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T04:30:29.578030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T04:30:29.383Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 194 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "8b71c006-6344-456d-9aaa-1833d7be5ee8" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.144:45872 10.134.0.144:443 10.132.0.15:57234 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T04:30:34.019089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:31:01.475773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:31:40.102477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:31:58.871112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:32:02.254930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:32:11.798259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:32:16.752485Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T04:32:16.654Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 98 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "004ffce3-8afa-44b9-aca9-032befb32b6c" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.144:54852 10.134.0.144:443 10.132.0.15:32842 - v1-catch-all-path 2026-10-31T04:32:25.454018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:32:34.656906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:32:37.543023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:32:37.543059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:32:37.543074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:32:37.543079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T04:32:37.217Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 325 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "e016c913-ee45-4d31-9b63-c434a902b37f" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.144:41022 10.134.0.144:443 10.132.0.15:48194 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T04:32:51.544181Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:33:03.345063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:33:07.926060Z info ads ADS: new connection for node:3 2026-10-31T04:33:07.926246Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T04:33:07.926275Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T04:33:14.887987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:33:54.190405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T04:34:04.171Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 349 87 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "abbec19a-c5b3-4ebc-b106-47bfbb351417" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.202:8000" outbound|54321||e2e-prio-pool-7010fecc-inference-pool-ip-529cbf0f.llm.svc.cluster.local 10.134.0.144:59948 10.134.0.144:443 10.132.0.15:54090 - v1-model-routing 2026-10-31T04:34:18.259085Z info ads ADS: "" 3 terminated with stream closed 2026-10-31T04:34:18.565567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:34:23.456840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:34:40.467813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:37:11.106283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:37:33.857320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:38:01.280079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:38:12.846883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:38:19.548586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:38:32.592858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:38:37.421272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T04:38:41.294Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "ad81e873-5772-43b6-a306-0ecce5778c1f" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.144:443 10.132.0.15:43738 - v1-completions-path 2026-10-31T04:38:55.339372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:39:43.490405Z info ads ADS: new connection for node:4 2026-10-31T04:39:43.495131Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T04:39:43.495185Z info cache read certificate from file resource=file-root:system 2026-10-31T04:39:47.391713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:39:48.443969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:40:15.306725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:40:15.306764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:40:15.306778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:40:15.306784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T04:40:15.306988Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T04:40:15.106Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 200 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "aaec76f5-c4f1-42ab-b497-e7e72d4abd6c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.144:47458 10.134.0.144:443 10.132.0.15:32848 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T04:41:19.332538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:41:19.332576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:41:19.332591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:41:19.332596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:41:19.332793Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T04:41:19.133Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1711 198 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "ce8382d1-d8eb-4708-895e-c60f9a0931ec" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.144:34828 10.134.0.144:443 10.132.0.15:47736 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T04:41:43.903798Z info ads ADS: "" 4 terminated 2026-10-31T04:41:43.976814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:41:46.669581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:41:48.505562Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T04:41:48.505588Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T04:41:48.505591Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T04:41:48.505596Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T04:41:48.157Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 348 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "d3b44302-8ea3-4421-a025-f07c881bb394" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.144:443 10.132.0.15:46830 - v1-completions-path 2026-10-31T04:41:57.066671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:42:01.083037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-31T04:42:01.013Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 89 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "42404d1d-c140-463e-818e-d668c1bf9c10" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.144:44568 10.134.0.144:443 10.132.0.15:37350 - v1-completions-path 2026-10-31T04:42:16.354132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:42:20.936175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:42:24.312006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T04:42:24.253Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 289 67 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "f5009694-e25d-443e-863d-ca4cdad7f9b4" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.144:38854 10.134.0.144:443 10.132.0.15:55678 - v1-completions-path [2026-10-31T04:42:25.042Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 62 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "271c14bd-2d2a-4ba5-ae52-4a2b3fe5022e" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.144:44568 10.134.0.144:443 10.132.0.15:55702 - v1-completions-path 2026-10-31T04:42:45.025785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:42:59.760438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:43:31.941902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:43:42.589676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:43:48.958870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T04:44:00.142Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "c1e29426-dc13-4682-8286-074db93bb28c" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.144:38854 10.134.0.144:443 10.132.0.15:35046 - v1-completions-path [2026-10-31T04:44:02.478Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "72d8deaa-f162-4d7a-9485-837c3a611f8f" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.144:44568 10.134.0.144:443 10.132.0.15:35052 - v1-completions-path 2026-10-31T04:44:16.972643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:44:21.330255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T04:44:22.012Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 290 139 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "e80d64b3-24f9-46d2-ba25-579e7ace72a1" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.134.0.144:59954 10.134.0.144:443 10.132.0.15:55954 - v1-completions-path 2026-10-31T04:44:32.682806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:44:41.149406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:44:51.320122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:44:59.773766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:45:08.894275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:45:27.040187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:45:32.989176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T04:45:35.377Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 460 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "0d86fdf2-2a27-458d-b85b-d42172c03f89" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.144:443 10.132.0.15:40168 - v1-completions-path 2026-10-31T04:45:53.295254Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:45:58.384766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:46:00.872825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:46:00.872857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:46:00.872870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T04:46:00.872900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T04:46:00.764Z] "DELETE /v1/api-keys/6ce61866-cd50-4838-bdbb-6e05c1a1ae4d HTTP/1.1" 404 - via_upstream - "-" 0 29 108 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "06895d9f-33d3-4664-a75e-15a42306aaef" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.22:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.144:49098 10.134.0.144:443 10.132.0.15:54536 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T04:46:02.556Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 34 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "acf943b9-1f2a-4436-ba16-f6ef45f3f1fb" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.144:443 10.132.0.15:54542 - v1-completions-path 2026-10-31T04:46:10.694076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:46:33.263040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:46:44.074107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T04:46:59.046Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "ab716ca5-120d-4a37-9801-5b428d3fef41" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.144:443 10.132.0.15:56134 - v1-completions-path 2026-10-31T04:47:03.024538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:47:10.566283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:49:36.277127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:50:57.666440Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T04:51:05.300080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:51:22.635124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:51:27.730173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:51:41.231285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:51:56.739207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:52:00.382482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:52:29.637788Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:52:40.349593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:52:46.527241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T04:53:00.549Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 67 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "c1f71ba4-a7d5-4ece-8cb0-dc825a18bc49" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.144:38854 10.134.0.144:443 10.132.0.15:41986 - v1-completions-path 2026-10-31T04:53:16.908866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:53:23.292535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:53:29.778226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:53:44.716550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:53:44.716586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:53:44.716602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:53:44.716607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T04:53:44.596Z] "DELETE /v1/api-keys/bfc5bba3-8565-437b-b8f6-3ff2ba7d3137 HTTP/1.1" 200 - via_upstream - "-" 0 363 119 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "c0ce0c59-cc1c-496a-a55e-2750add865b0" "maas.apps.6b93ef1713d6ca59dc0c.prod.konflux-ocp-ci.dev" "10.132.1.152:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.144:37744 10.134.0.144:443 10.132.0.15:39428 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T04:53:58.677417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:54:09.340389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:54:16.094051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:54:22.306038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:54:32.065377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:54:57.187570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:55:07.934534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:55:12.881955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:55:30.958824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:55:37.409557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:55:58.487366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:56:18.393958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:56:29.369051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:56:40.221852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:56:51.287418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:57:01.957027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:57:12.886088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:57:23.447017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:57:34.258772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:57:45.038382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T04:57:55.762300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9