2026-11-03T19:50:10.114407Z info FLAG: --concurrency="0" 2026-11-03T19:50:10.114433Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T19:50:10.114440Z info FLAG: --help="false" 2026-11-03T19:50:10.114443Z info FLAG: --log_as_json="false" 2026-11-03T19:50:10.114446Z info FLAG: --log_caller="" 2026-11-03T19:50:10.114450Z info FLAG: --log_output_level="default:info" 2026-11-03T19:50:10.114453Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T19:50:10.114461Z info FLAG: --log_target="[stdout]" 2026-11-03T19:50:10.114465Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T19:50:10.114468Z info FLAG: --outlierLogPath="" 2026-11-03T19:50:10.114471Z info FLAG: --profiling="true" 2026-11-03T19:50:10.114474Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T19:50:10.114477Z info FLAG: --proxyLogLevel="warning" 2026-11-03T19:50:10.114480Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T19:50:10.114484Z info FLAG: --stsPort="0" 2026-11-03T19:50:10.114487Z info FLAG: --templateFile="" 2026-11-03T19:50:10.114489Z info FLAG: --tokenManagerPlugin="" 2026-11-03T19:50:10.114494Z info FLAG: --vklog="0" 2026-11-03T19:50:10.114498Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T19:50:10.114712Z info Proxy role ips=[10.134.0.64] type=router id=maas-default-gateway-openshift-default-855f9574cf-zst5d.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T19:50:10.114792Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T19:50:10.116756Z info cpu limit detected as 2, setting concurrency 2026-11-03T19:50:10.117159Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T19:50:10.117179Z info JWT policy is third-party-jwt 2026-11-03T19:50:10.117183Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T19:50:10.120630Z info Starting default Istio SDS Server 2026-11-03T19:50:10.120720Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T19:50:10.120794Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T19:50:10.121592Z info Opening status port 15020 2026-11-03T19:50:10.122684Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T19:50:10.125656Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T19:50:10.127638Z info Starting proxy agent 2026-11-03T19:50:10.127760Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T19:50:10.130186Z info sds Starting SDS grpc server 2026-11-03T19:50:10.130244Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T19:50:10.239141Z info cache generated new workload certificate resourceName=default latency=110.971733ms ttl=23h59m59.760862523s 2026-11-03T19:50:10.239190Z info cache Root cert has changed, start rotating root cert 2026-11-03T19:50:10.239253Z info cache returned workload trust anchor from cache ttl=23h59m59.760748414s 2026-11-03T19:50:10.279432Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T19:50:10.516590Z info ads ADS: new connection for node:1 2026-11-03T19:50:10.529387Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T19:50:10.529531Z info cache read certificate from file resource=file-root:system 2026-11-03T19:50:10.568850Z info ads ADS: new connection for node:2 2026-11-03T19:50:10.569148Z info cache returned workload certificate from cache ttl=23h59m59.430857479s 2026-11-03T19:50:10.569424Z info ads ADS: new connection for node:3 2026-11-03T19:50:10.569535Z info cache returned workload trust anchor from cache ttl=23h59m59.430466628s 2026-11-03T19:50:10.725693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:50:19.212236Z info Readiness succeeded in 9.107832335s 2026-11-03T19:50:19.212742Z info Envoy proxy is ready 2026-11-03T19:50:30.034220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:50:47.710476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:50:47.710510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:50:47.710518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:50:47.710522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T19:50:47.710691Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T19:50:47.556Z] "POST /anything/e2e-rt-sw-9bda1e-client HTTP/1.1" 200 - via_upstream - "-" 124 1582 154 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "de6aa431-1a0d-419d-9816-61711fdc9a7e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.64:59014 10.134.0.64:443 10.132.0.9:41920 - llm.external-model-e2e-rt-sw-9bda1e-36ead220d519.0 2026-11-03T19:50:58.171244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:06.487198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:12.087466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:12.087515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:12.087532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:12.087538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T19:51:12.087826Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-03T19:51:12.501865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:12.501998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:12.502045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T19:51:12.502088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:12.502440Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T19:51:11.901Z] "POST /anything/e2e-rt-eq-be9385-client HTTP/1.1" 200 - via_upstream - "-" 124 1575 186 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e4ccdbb7-75f4-48ee-9d25-ef7d26ec126a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.64:36108 10.134.0.64:443 10.132.0.9:41516 - llm.external-model-e2e-rt-eq-be9385-b6430985953f.2 [2026-11-03T19:51:12.357Z] "POST /anything/e2e-rt-eq-be9385-client HTTP/1.1" 200 - via_upstream - "-" 124 1585 144 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ddf293db-d444-4145-b3ae-4f60f638985e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.64:36120 10.134.0.64:443 10.132.0.9:59314 - llm.external-model-e2e-rt-eq-be9385-b6430985953f.0 2026-11-03T19:51:33.385584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:38.929273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:38.961932Z info ads ADS: "" 1 terminated with stream closed 2026-11-03T19:51:48.820864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:52:38.174857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:52:53.882876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:53:13.272098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:54:47.488312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:19.118257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:19.118289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:19.118302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:19.118306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T19:55:18.271Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 48 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "8f1ce2ae-5015-4219-811f-8f2dffa5337a" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.64:443 10.132.0.9:50770 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:55:19.042Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 76 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "dd051c9c-e205-499b-8183-79dc480407b6" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:36614 10.134.0.64:443 10.132.0.9:50778 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:55:19.634611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:19.634722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:19.634757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T19:55:19.634797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:19.634826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T19:55:19.478Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 156 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "96b800c5-ef57-429e-91d5-76bb715baa92" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:36614 10.134.0.64:443 10.132.0.9:50780 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:55:19.805Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 37 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "9f600025-61c5-4f3d-95d1-7dc0278acab4" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.64:443 10.132.0.9:50784 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:55:22.661171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:22.661247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:22.661262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:22.661267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T19:55:22.590Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 70 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "22a7c33e-7a52-4497-b807-8ceca10d59b4" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:36614 10.134.0.64:443 10.132.0.9:56108 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:55:31.133Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 84 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "3249b499-d28b-41bd-a4ef-be46893e4153" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:53414 10.134.0.64:443 10.132.0.9:56126 - v1-completions-path 2026-11-03T19:55:37.382909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:37.382945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:37.382957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:37.382962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:55:37.295Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 87 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "98218550-a27a-40e7-8cf3-dcb976a0bdf5" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:34488 10.134.0.64:443 10.132.0.9:41106 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:59:11.030Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 324 67 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c4c98979-02cd-4728-98da-7f7b09e7ad9e" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:39040 10.134.0.64:443 10.132.0.9:58676 - v1-chat-completions-path 2026-11-03T20:00:44.285277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:00:44.285422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:00:44.285481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:00:44.285512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:00:44.062Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 222 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b2ab6d32-5669-44cc-a70a-298cd22fb4d1" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:37132 10.134.0.64:443 10.132.0.9:47604 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:09:46.380353Z info ads ADS: new connection for node:4 2026-11-03T20:09:46.398703Z info cache read certificate from file resource=file-root:system 2026-11-03T20:15:45.757032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:16:15.252083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:16:19.397555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:16:19.397600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:16:19.397620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:16:19.397626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:16:19.145Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 252 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "6ae72197-3642-4f81-a4a6-4c2b380936ca" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:43516 10.134.0.64:443 10.132.0.9:38238 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:16:57.602756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:17:35.907631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:18:26.541068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:18:44.966412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:19:43.215156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:20:40.398991Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:20:44.462096Z info ads ADS: new connection for node:5 2026-11-03T20:20:44.463342Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T20:20:44.463499Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T20:21:27.559131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:21:56.196530Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T20:22:29.427703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:22:51.437413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:23:39.539402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:24:58.291915Z info ads ADS: "" 5 terminated 2026-11-03T20:27:44.102509Z warn xdsproxy upstream terminated with unexpected error rpc error: code = Unavailable desc = keepalive ping failed to receive ACK within timeout id=2 2026-11-03T20:27:44.564621Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T20:28:08.829954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:28:23.074399Z info ads ADS: "" 4 terminated 2026-11-03T20:30:20.947042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:30:55.002558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:31:21.687116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:33:14.377319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:50.447128Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T20:42:14.263354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:42:37.575452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:11.461386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:15.840273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:26.317689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:42.286432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:43.959158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:49.490498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:43:53.129Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 63 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "90f9867c-fd2a-4f74-97f3-4bde635a5485" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.64:443 10.133.1.17:34636 - v1-catch-all-path 2026-11-03T20:44:04.738409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:06.369637Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:30.221891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:41.020625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:43.618688Z info ads ADS: new connection for node:6 2026-11-03T20:44:43.618920Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T20:44:43.618976Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T20:44:45.218851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:45:25.187389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:45:44.423227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:45:44.964702Z info ads ADS: "" 6 terminated 2026-11-03T20:45:46.259855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:45:57.305195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:45:57.305264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:45:57.305277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:45:57.305282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:45:57.574465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:45:57.238Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 333 66 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "cd448f6c-4bcd-4539-92f7-962eac1630fb" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:47202 10.134.0.64:443 10.133.1.17:57978 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:46:08.940107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:48:21.653315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:48:39.053228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:04.725681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:16.310126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:19.687692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:28.742797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:30.919058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:33.677796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:49:33.677837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:49:33.677851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:49:33.677855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:49:33.609Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 68 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "e538c2de-a47a-48fa-8d9f-453f73583574" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:40794 10.134.0.64:443 10.133.1.17:46798 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:49:34.771855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T20:49:34.939409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:49:34.939445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:49:34.939460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:49:34.939464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:49:34.766Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "2eafc562-d6a2-43a5-adde-df0b354d0fcd" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.64:443 10.133.1.17:46800 - v1-completions-path [2026-11-03T20:49:34.883Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 55 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "5a153e12-8b24-46d8-b56c-8ef0a3d39816" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:40794 10.134.0.64:443 10.133.1.17:46806 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:49:46.415320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:50:30.931900Z info ads ADS: new connection for node:7 2026-11-03T20:50:30.937254Z info cache read certificate from file resource=file-root:system 2026-11-03T20:50:31.459513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:50:33.055385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:51:15.342071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:51:15.342108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:51:15.342119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:51:15.342123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:51:15.342311Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T20:51:15.212Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1537 129 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "8a28f38b-8508-4461-9d0f-6e573cabfeed" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.64:35640 10.134.0.64:443 10.133.1.17:45492 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T20:52:17.861102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:18.051061Z info ads ADS: "" 7 terminated with stream closed 2026-11-03T20:52:18.528816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:21.233952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:23.163798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:52:25.796Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 111 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "de6e1ba8-b252-4e8e-9179-e009671ed775" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:33166 10.134.0.64:443 10.133.1.17:59536 - v1-completions-path 2026-11-03T20:52:39.950980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:51.197862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:52:54.723Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 62 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "1a0db24d-d329-4249-bf2c-956a31cc3299" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.64:443 10.133.1.17:36344 - v1-completions-path 2026-11-03T20:53:06.580451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:08.308752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:11.169744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:19.397272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:22.231568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:53:22.231606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:53:22.231619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:53:22.231624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:53:22.130Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 101 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "5df7c00a-cdfa-484f-ad5c-133d1c8a4ef4" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:42104 10.134.0.64:443 10.133.1.17:44240 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:53:22.663Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 67 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "515e7722-7d71-419f-a487-9b6a7ec4613b" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:33166 10.134.0.64:443 10.133.1.17:44252 - v1-completions-path [2026-11-03T20:53:22.788Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "e12e1b8d-fa9f-4305-b287-91fa3fb0776b" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:33166 10.134.0.64:443 10.133.1.17:44266 - v1-completions-path [2026-11-03T20:53:23.002Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 68 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "584da9ff-1b31-4916-a4ab-1c3533e42486" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:55388 10.134.0.64:443 10.133.1.17:44274 - v1-completions-path [2026-11-03T20:53:24.193Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 55 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "f832e0de-e413-4461-8508-4bf2b493cc1b" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:55388 10.134.0.64:443 10.133.1.17:44288 - v1-completions-path 2026-11-03T20:53:40.872356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:50.984162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:02.731965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:19.264500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:20.914298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:35.957529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:38.124762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:44.001151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:52.416519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:55:06.199330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:55:36.811938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:55:39.392684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:55:40.105507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:55:40.105542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:55:40.105555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:55:40.105560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:55:39.998Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 107 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "7bf03eb6-6c87-4232-a836-d573437b4a0a" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:34254 10.134.0.64:443 10.133.1.17:53022 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:56:04.733796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:56:06.882382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:56:07.081Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 132 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "e7f2d793-4aed-442e-82e0-0305f37fd311" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:53544 10.134.0.64:443 10.133.1.17:52424 - v1-completions-path 2026-11-03T20:56:11.159389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:56:36.424867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:56:56.636152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:57:11.308Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 39 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "958526c0-6631-45d0-9298-2c77203eceda" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.64:443 10.133.1.17:50346 - v1-completions-path 2026-11-03T20:57:12.981883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:57:15.596291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:59:25.337733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:59:34.983146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:59:46.945390Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-11-03T21:01:04.354012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:18.551613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:20.279039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:22.989849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:01:22.989914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:01:22.989934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:01:22.989941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T21:01:22.890Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 99 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "fc8ddbe1-cf98-443b-b390-a700012ba79f" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:53230 10.134.0.64:443 10.133.1.17:50718 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:01:25.653855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:54.528077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:58.534586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:02:02.420Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "cc5921ef-63fd-4c29-aece-acd1ac5eacb1" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:33166 10.134.0.64:443 10.133.1.17:36910 - v1-completions-path 2026-11-03T21:02:14.756088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:02:35.005872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:02:38.052438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:02:41.911Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "ffc09b55-1813-4856-b738-77c29d403ad3" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:33166 10.134.0.64:443 10.133.1.17:40400 - v1-completions-path [2026-11-03T21:02:42.247Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "bfa1b7e6-5f63-4ebe-8eaf-072bece66f51" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:55388 10.134.0.64:443 10.133.1.17:40408 - v1-completions-path 2026-11-03T21:02:54.807966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:02:56.909118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:00.013075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:03.566691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:03:03.566725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:03:03.566737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:03:03.566743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T21:03:03.497Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 69 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "c237e1b2-a3ba-4b19-b626-85f6d0b27758" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.216:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:33074 10.134.0.64:443 10.133.1.17:52198 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:03:03.748Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 69 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "6a850c0c-37e0-4839-a2c2-6fe0c183623d" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:33166 10.134.0.64:443 10.133.1.17:52206 - v1-completions-path [2026-11-03T21:03:07.439Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "78446ed3-5b54-4b0f-b377-305cc9a139b9" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:33166 10.134.0.64:443 10.133.1.17:45754 - v1-completions-path 2026-11-03T21:03:09.457713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:03:09.457748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:03:09.457761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:03:09.457766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T21:03:09.394Z] "DELETE /v1/api-keys/9509e209-702c-40be-93d8-006d8e7bc81b HTTP/1.1" 200 - via_upstream - "-" 0 365 62 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "751f380d-69ab-4978-8df3-649fe965e23c" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.134.1.66:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:33466 10.134.0.64:443 10.133.1.17:45762 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:03:20.985813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:31.204302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:33.401629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:36.322121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:39.933781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:03:39.933816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:03:39.933829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:03:39.933833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T21:03:39.873Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 60 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "ebebaecd-f026-40ea-949c-308c55e61a32" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.134.1.66:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.64:33466 10.134.0.64:443 10.133.1.17:48164 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:03:41.553392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:03:45.570Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "ec010248-a2d9-4f71-b8e1-84076b9408bb" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:33166 10.134.0.64:443 10.133.1.17:47544 - v1-completions-path [2026-11-03T21:03:45.792Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "2269efd8-726f-4cad-b49c-c196a64fed7f" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.64:55388 10.134.0.64:443 10.133.1.17:47554 - v1-completions-path 2026-11-03T21:03:58.347611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:08.604191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:10.255677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:17.154085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:20.146926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:23.447416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:39.335402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:59.246470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:09.433838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:19.741268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:29.861141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:40.057537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:50.240457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:00.445042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:10.633056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:20.838823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:31.112984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8