2026-11-02T21:22:11.067392Z info FLAG: --concurrency="0" 2026-11-02T21:22:11.067409Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T21:22:11.067413Z info FLAG: --help="false" 2026-11-02T21:22:11.067415Z info FLAG: --log_as_json="false" 2026-11-02T21:22:11.067417Z info FLAG: --log_caller="" 2026-11-02T21:22:11.067419Z info FLAG: --log_output_level="default:info" 2026-11-02T21:22:11.067421Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T21:22:11.067425Z info FLAG: --log_target="[stdout]" 2026-11-02T21:22:11.067427Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T21:22:11.067429Z info FLAG: --outlierLogPath="" 2026-11-02T21:22:11.067431Z info FLAG: --profiling="true" 2026-11-02T21:22:11.067433Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T21:22:11.067435Z info FLAG: --proxyLogLevel="warning" 2026-11-02T21:22:11.067437Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T21:22:11.067439Z info FLAG: --stsPort="0" 2026-11-02T21:22:11.067441Z info FLAG: --templateFile="" 2026-11-02T21:22:11.067443Z info FLAG: --tokenManagerPlugin="" 2026-11-02T21:22:11.067446Z info FLAG: --vklog="0" 2026-11-02T21:22:11.067453Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T21:22:11.067580Z info Proxy role ips=[10.133.0.211] type=router id=maas-default-gateway-openshift-default-5db77fbd9f-nzffk.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T21:22:11.067622Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T21:22:11.069232Z info cpu limit detected as 2, setting concurrency 2026-11-02T21:22:11.069516Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T21:22:11.069531Z info JWT policy is third-party-jwt 2026-11-02T21:22:11.069535Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T21:22:11.071036Z info Starting default Istio SDS Server 2026-11-02T21:22:11.071070Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T21:22:11.071093Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T21:22:11.071463Z info Opening status port 15020 2026-11-02T21:22:11.072619Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T21:22:11.073435Z info sds Starting SDS grpc server 2026-11-02T21:22:11.073450Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T21:22:11.074259Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T21:22:11.075015Z info Starting proxy agent 2026-11-02T21:22:11.075044Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T21:22:11.142168Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T21:22:11.257288Z info cache generated new workload certificate resourceName=default latency=183.717782ms ttl=23h59m59.742716978s 2026-11-02T21:22:11.257322Z info cache Root cert has changed, start rotating root cert 2026-11-02T21:22:11.257354Z info cache returned workload trust anchor from cache ttl=23h59m59.742646257s 2026-11-02T21:22:11.289473Z info ads ADS: new connection for node:1 2026-11-02T21:22:11.289537Z info cache returned workload certificate from cache ttl=23h59m59.710465458s 2026-11-02T21:22:11.289720Z info ads ADS: new connection for node:2 2026-11-02T21:22:11.289827Z info cache returned workload trust anchor from cache ttl=23h59m59.710174198s 2026-11-02T21:22:11.372545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:22:19.699585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:22:20.615991Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T21:22:22.099988Z info Readiness succeeded in 11.035151179s 2026-11-02T21:22:22.100413Z info Envoy proxy is ready 2026-11-02T21:22:22.140773Z info ads ADS: new connection for node:3 2026-11-02T21:22:22.140929Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T21:22:22.140959Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T21:22:22.268518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:05.627031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:23:08.786Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 326 112 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b83fbed2-d358-4624-8463-e8120029f934" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.212:8000" outbound|54321||e2e-prio-pool-006730b5-inference-pool-ip-8d0ecc4a.llm.svc.cluster.local 10.133.0.211:58380 10.133.0.211:443 10.132.0.22:60562 - v1-model-routing 2026-11-02T21:23:29.237725Z info ads ADS: "" 3 terminated with stream closed 2026-11-02T21:23:29.536941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:34.168769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:50.010147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:26:23.304105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:26:50.490813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:21.511555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:36.676584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:42.875421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:54.354014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:57.325324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:28:15.350887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:29:03.086235Z info ads ADS: new connection for node:4 2026-11-02T21:29:03.093126Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T21:29:03.093174Z info cache read certificate from file resource=file-root:system 2026-11-02T21:29:06.676892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:29:08.003051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:29:34.448160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:29:34.448190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:29:34.448198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:29:34.448203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:29:34.448350Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T21:29:34.255Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1729 193 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6bca583d-74e8-4a27-b517-be99a860b061" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.211:55410 10.133.0.211:443 10.132.0.22:34460 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:29:48.686524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:48.686556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:48.686564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T21:29:48.686569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:48.686709Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T21:29:48.491Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 195 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "254a6f2a-95ae-44e2-8343-dcff378021f4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.211:57972 10.133.0.211:443 10.132.0.22:45880 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:29:53.382568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:53.382599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:53.382608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:53.382612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T21:29:53.382782Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T21:29:53.260Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1726 122 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "f4665c67-4762-46c6-8ded-030a9d57e6c7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.211:57972 10.133.0.211:443 10.132.0.22:45896 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:30:05.151372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:30:05.151403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:30:05.151412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:30:05.151416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:30:05.151591Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T21:30:05.024Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1727 127 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "28b3211f-d85e-489c-a9a2-bbb2ebd169a7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.211:55410 10.133.0.211:443 10.132.0.22:55998 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:30:36.661361Z info ads ADS: "" 4 terminated with stream closed 2026-11-02T21:30:36.704392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:30:39.252514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:30:49.474934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:30:52.258Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 78 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "94ccc469-8177-483d-867d-b1a059d3f1c6" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:56222 10.133.0.211:443 10.132.0.22:49088 - v1-completions-path 2026-11-02T21:31:07.731072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:12.183638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:17.920595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T21:31:17.914Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c3447ee4-59c8-4a2f-b832-6bcdd5f2ab6f" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:37414 10.133.0.211:443 10.132.0.22:58100 - v1-completions-path 2026-11-02T21:31:32.236180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:50.685589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:57.933226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T21:31:57.926Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9bfbef46-1ba1-43da-9f73-7c0be9919f11" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:56222 10.133.0.211:443 10.132.0.22:52096 - v1-completions-path 2026-11-02T21:32:19.210080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:32:29.797093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:32:36.037388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:04.418947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:08.713380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:09.117043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:33:09.117096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:33:09.117123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:33:09.117130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T21:33:08.972Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 145 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "625a3b67-16eb-4b29-b522-9af8b37f611b" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.211:38808 10.133.0.211:443 10.132.0.22:59170 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:33:21.528266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:30.246292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:39.399692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:45.384669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:59.293587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:14.329428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:20.011943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:34:19.507Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 61 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "dc13d152-fb7c-4bc4-9043-d08f9b2a0c43" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.211:443 10.132.0.22:50144 - v1-completions-path 2026-11-02T21:34:37.991569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:43.261352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:54.071497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:03.595445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:35:03.595484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:35:03.595501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:35:03.595506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T21:35:03.478Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 117 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "28fdd636-ab1b-45db-88a5-3f1e17b633e8" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.211:42648 10.133.0.211:443 10.132.0.22:36608 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:35:18.047033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:28.761590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:49.072378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:56.514055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:38:22.157794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:39:28.769238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:39:28.769284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:39:28.769304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:39:28.769311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T21:39:28.652Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 116 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "31c5e02c-057b-44ea-98c2-715dfbb8d110" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.211:45706 10.133.0.211:443 10.132.0.22:57292 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:39:51.776604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:08.989321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:13.755677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:26.417257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:42.622101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:49.005552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:40:52.363Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "8e067cf3-9dec-47f9-b31d-d1c0e3c296ea" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:37414 10.133.0.211:443 10.132.0.22:60274 - v1-completions-path 2026-11-02T21:40:54.788369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:40:54.788414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:40:54.788438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:40:54.788445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T21:40:54.675Z] "DELETE /v1/api-keys/03f0316b-1226-43ee-aeb2-e1c9d6b5c51a HTTP/1.1" 200 - via_upstream - "-" 0 369 113 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "4a807e40-99f7-4110-8f92-10ab739623ec" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.227:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.211:52556 10.133.0.211:443 10.132.0.22:60286 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:41:08.575782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:19.268936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:25.401624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:41:36.265Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "30c9461e-bef6-4d6f-8e5d-1b5c18cc02d4" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:56222 10.133.0.211:443 10.132.0.22:44502 - v1-completions-path 2026-11-02T21:41:52.657149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:58.811772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:04.592773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:42:12.686Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "0b5dd814-ffd4-4690-af6e-951cfd0299c9" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:37414 10.133.0.211:443 10.132.0.22:59124 - v1-completions-path [2026-11-02T21:42:14.381Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "f0826d25-4388-4db4-bb58-9c7fde050169" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:56222 10.133.0.211:443 10.132.0.22:59138 - v1-completions-path [2026-11-02T21:42:17.992Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "7717a204-9438-46a1-9544-3f1602159274" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:56222 10.133.0.211:443 10.132.0.22:41172 - v1-completions-path 2026-11-02T21:42:35.069525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:45.835835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:52.056599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:57.928493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:07.176638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:43:16.498Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "dd0c842f-65b2-4ada-b954-ffe6deece81d" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.211:443 10.132.0.22:33164 - v1-completions-path 2026-11-02T21:43:30.323075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:41.078457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:45.667936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:03.881954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:10.804128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:20.076952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:41.664799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:01.722954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:14.257823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:33.892415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:44.679357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:55.368076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:06.100444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:16.898504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:27.434932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:31.877927Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T21:46:31.877952Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T21:46:31.877955Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T21:46:31.877959Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T21:46:31.854Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 23 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "1a2793a6-2cca-405a-b1a6-00aecf9ee937" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.211:443 10.132.0.22:50088 - v1-completions-path [2026-11-02T21:46:36.860Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 85 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "38694641-42b2-4df9-968b-1ff5e70ba396" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:37184 10.133.0.211:443 10.132.0.22:56092 - v1-completions-path [2026-11-02T21:46:37.617Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 71 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b439aa13-d043-4f41-8100-1141c35cdc6e" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.211:37184 10.133.0.211:443 10.132.0.22:56094 - v1-completions-path