2026-10-30T04:35:07.776254Z info FLAG: --concurrency="0" 2026-10-30T04:35:07.776272Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T04:35:07.776275Z info FLAG: --help="false" 2026-10-30T04:35:07.776278Z info FLAG: --log_as_json="false" 2026-10-30T04:35:07.776280Z info FLAG: --log_caller="" 2026-10-30T04:35:07.776282Z info FLAG: --log_output_level="default:info" 2026-10-30T04:35:07.776284Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T04:35:07.776288Z info FLAG: --log_target="[stdout]" 2026-10-30T04:35:07.776291Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T04:35:07.776293Z info FLAG: --outlierLogPath="" 2026-10-30T04:35:07.776295Z info FLAG: --profiling="true" 2026-10-30T04:35:07.776297Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T04:35:07.776299Z info FLAG: --proxyLogLevel="warning" 2026-10-30T04:35:07.776303Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T04:35:07.776306Z info FLAG: --stsPort="0" 2026-10-30T04:35:07.776309Z info FLAG: --templateFile="" 2026-10-30T04:35:07.776312Z info FLAG: --tokenManagerPlugin="" 2026-10-30T04:35:07.776315Z info FLAG: --vklog="0" 2026-10-30T04:35:07.776319Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T04:35:07.776467Z info Proxy role ips=[10.133.1.149] type=router id=maas-default-gateway-openshift-default-64d4cc998c-d8hr5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T04:35:07.776516Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T04:35:07.778079Z info cpu limit detected as 2, setting concurrency 2026-10-30T04:35:07.778360Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T04:35:07.778372Z info JWT policy is third-party-jwt 2026-10-30T04:35:07.778375Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T04:35:07.780759Z info Starting default Istio SDS Server 2026-10-30T04:35:07.780780Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T04:35:07.780763Z info Opening status port 15020 2026-10-30T04:35:07.780804Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T04:35:07.781684Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T04:35:07.783472Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T04:35:07.784946Z info Starting proxy agent 2026-10-30T04:35:07.784989Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T04:35:07.792109Z info sds Starting SDS grpc server 2026-10-30T04:35:07.792126Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T04:35:07.853237Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T04:35:07.999461Z info ads ADS: new connection for node:1 2026-10-30T04:35:08.000165Z info ads ADS: new connection for node:2 2026-10-30T04:35:08.080376Z info cache generated new workload certificate resourceName=default latency=297.943721ms ttl=23h59m59.919629134s 2026-10-30T04:35:08.080418Z info cache Root cert has changed, start rotating root cert 2026-10-30T04:35:08.080470Z info cache returned workload trust anchor from cache ttl=23h59m59.919530572s 2026-10-30T04:35:08.080492Z info cache returned workload certificate from cache ttl=23h59m59.91950931s 2026-10-30T04:35:08.080556Z info cache returned workload trust anchor from cache ttl=23h59m59.919446978s 2026-10-30T04:35:08.080884Z info cache returned workload trust anchor from cache ttl=23h59m59.919116471s 2026-10-30T04:35:08.185060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:35:15.107555Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-10-30T04:35:16.093699Z info Readiness succeeded in 8.320663998s 2026-10-30T04:35:16.094013Z info Envoy proxy is ready 2026-10-30T04:35:35.856199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:35:40.698Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 2817 3089 86 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7226205c-8097-4a38-8eba-86a6d4af501c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:38990 10.133.1.149:443 10.132.0.20:56586 - v1-chat-completions-path 2026-10-30T04:35:53.285705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:35:55.751737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:03.512739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:36:03.512784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:36:03.512804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:36:03.512810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:36:03.619596Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T04:36:03.429Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 83 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "feb088c0-6afe-445b-a9e1-6b2493fd0bd4" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.149:43380 10.133.1.149:443 10.132.0.20:33946 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:36:03.546Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "29143664-6ab6-4b37-b999-72020e574945" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.30:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:59344 10.133.1.149:443 10.132.0.20:33962 - v1-catch-all-path 2026-10-30T04:36:06.697018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:12.227737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:36:12.227772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:36:12.227785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:36:12.227789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:36:12.155Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c875e2d6-23aa-4c04-bc94-f311d4f20007" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.149:59730 10.133.1.149:443 10.132.0.20:41382 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:36:24.741218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:26.988762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:41.745646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:52.524878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:54.503068Z info ads ADS: new connection for node:3 2026-10-30T04:36:54.503242Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:36:54.503274Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:36:56.194168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:37:36.553271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:38:00.714761Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T04:38:00.762200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:38:02.222873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:38:04.388028Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:38:09.476931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:39:45.903161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:02.994835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:23.820979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:35.833515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:39.476731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:49.724759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:54.117477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:41:00.073Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "221e1ba7-da41-41d6-b31c-01e7ede4726e" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.149:443 10.132.0.20:51866 - v1-completions-path 2026-10-30T04:41:12.286566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:41:56.234723Z info ads ADS: new connection for node:4 2026-10-30T04:41:56.239371Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T04:41:56.239426Z info cache read certificate from file resource=file-root:system 2026-10-30T04:41:57.351023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:41:58.885315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:42:35.853319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T04:42:35.908233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:42:35.908264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:42:35.908276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:42:35.908280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:42:35.908436Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T04:42:35.791Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 117 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ef331fe5-e650-4e02-8a31-e7a4fb51a69c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.149:39088 10.133.1.149:443 10.132.0.20:53368 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:42:59.366584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:42:59.366611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:42:59.366620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:42:59.366624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:42:59.366767Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T04:42:59.261Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 105 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "978dc405-c6c4-4b98-a42d-9c99da8044e4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.149:54860 10.133.1.149:443 10.132.0.20:40078 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:43:29.610673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:43:29.733448Z info ads ADS: "" 4 terminated with stream closed 2026-10-30T04:43:31.016205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:43:36.616315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:43:43.167Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 77 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d90913d0-0477-4e94-83c8-529b8f93b815" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:44418 10.133.1.149:443 10.132.0.20:47766 - v1-completions-path [2026-10-30T04:43:43.621Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "98c256cd-1f4e-476c-99c7-8a92dcfbc9b9" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.149:443 10.132.0.20:47778 - v1-completions-path 2026-10-30T04:43:55.545285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:00.096092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:15.443958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:17.768666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:20.679230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:30.897269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:38.355754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T04:44:38.300Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1a279649-8d8b-4cc1-8714-0dc80b901e97" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:44418 10.133.1.149:443 10.132.0.20:42374 - v1-completions-path 2026-10-30T04:44:54.411597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:04.680524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:09.123455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:45:13.974Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "297fa567-c7dd-47e0-8f2c-21db204b3cc3" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:44418 10.133.1.149:443 10.132.0.20:45342 - v1-completions-path 2026-10-30T04:45:26.362089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:28.682038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:47.802293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:52.214007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:46:06.085Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 89 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "409cadcc-875a-4ce4-8b6a-cd939eae8a7c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:47980 10.133.1.149:443 10.132.0.20:55424 - v1-completions-path 2026-10-30T04:46:07.702227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:10.021792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:27.641989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:38.323096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:41.182078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:46:58.265Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 37 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "5e4d0fb3-8121-428e-b4f3-842a92300e26" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.149:443 10.132.0.20:52264 - v1-completions-path 2026-10-30T04:47:00.364743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:03.310907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:08.816234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:47:08.816267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:47:08.816278Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:47:08.816284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:47:08.745Z] "DELETE /v1/api-keys/fe665879-bc55-4280-8f18-b080df4380a0 HTTP/1.1" 404 - via_upstream - "-" 0 29 70 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1305cc24-227b-4db4-9316-04205b56c6f6" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.149:37828 10.133.1.149:443 10.132.0.20:45736 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:47:15.584911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:33.382974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:43.717880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:48:03.032320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:48:06.343117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:49:48.053762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:49:51.429197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:51:21.496138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:51:21.983Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 289 110 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "f879e97c-b52a-47bf-abd4-74d5bad5fecf" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:35284 10.133.1.149:443 10.132.0.20:54362 - v1-completions-path 2026-10-30T04:51:35.953985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:51:38.319467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:51:56.902966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:08.467103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:12.210670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:15.066631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:52:15.066669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:52:15.066683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:52:15.066688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:52:14.986Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 79 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "175601f5-755c-4e67-bd67-ca624a396912" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.1.69:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.149:36590 10.133.1.149:443 10.132.0.20:50946 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:52:16.247234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:52:16.247279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:52:16.247295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:52:16.247299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:52:16.179Z] "DELETE /v1/api-keys/5b9e45fd-d872-4a11-bff2-f407958f4567 HTTP/1.1" 200 - via_upstream - "-" 0 369 68 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7d93ed7f-5240-46d3-807c-0343f9bba3a4" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.1.69:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.149:36590 10.133.1.149:443 10.132.0.20:50956 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:52:27.379261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:37.971646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:40.532093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:52:47.661Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "24b1e554-f357-4f51-aa8e-2fea53263a9e" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:44418 10.133.1.149:443 10.132.0.20:42642 - v1-completions-path [2026-10-30T04:52:47.840Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7d55aa13-9619-4111-81be-851d2ac28786" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:44418 10.133.1.149:443 10.132.0.20:42650 - v1-completions-path [2026-10-30T04:52:48.473Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "fa22e287-1a24-4186-93bd-b084ab69db33" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:50178 10.133.1.149:443 10.132.0.20:42664 - v1-completions-path 2026-10-30T04:53:00.719729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:05.267483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:08.214017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:53:16.163Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4d91d15b-790c-4185-90cc-d4d5d3527f82" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:50178 10.133.1.149:443 10.132.0.20:39422 - v1-completions-path 2026-10-30T04:53:31.080294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:41.471402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:45.952736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:49.001899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:54.000916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:12.280259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:22.478108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:24.792391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:34.250965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:39.074747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:55.537072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:55:15.331660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:55:26.568920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:55:46.179379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:55:56.665635Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:06.863779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:18.140293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:28.433169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:38.783324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:49.128886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:51.821077Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:56:51.821105Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:56:51.821108Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:56:51.821112Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T04:56:51.685Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 83 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "66c03e7e-c1a1-4c7c-be54-6d7cdd4b23bb" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:47980 10.133.1.149:443 10.132.0.20:47646 - v1-completions-path [2026-10-30T04:56:51.791Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 29 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "cd439731-0af9-4e9e-9353-379a96d49942" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.149:443 10.132.0.20:47658 - v1-completions-path 2026-10-30T04:56:58.057854Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:56:58.057879Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:56:58.057882Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:56:58.057886Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T04:56:58.036Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 21 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "43a8c9b1-77cf-4cb3-a497-91b36aaa57e9" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.149:443 10.132.0.20:53730 - v1-completions-path [2026-10-30T04:57:00.083Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 83 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c5d9ed4a-e02e-4fae-a3ea-4780021009cd" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:54350 10.133.1.149:443 10.132.0.20:53742 - v1-completions-path [2026-10-30T04:57:00.297Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 63 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2e0f5c86-d00f-4b3c-9200-d34d723e7649" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.149:54350 10.133.1.149:443 10.132.0.20:53752 - v1-completions-path