2026-11-03T13:44:53.543015Z info FLAG: --concurrency="0" 2026-11-03T13:44:53.543034Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T13:44:53.543038Z info FLAG: --help="false" 2026-11-03T13:44:53.543040Z info FLAG: --log_as_json="false" 2026-11-03T13:44:53.543042Z info FLAG: --log_caller="" 2026-11-03T13:44:53.543044Z info FLAG: --log_output_level="default:info" 2026-11-03T13:44:53.543045Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T13:44:53.543049Z info FLAG: --log_target="[stdout]" 2026-11-03T13:44:53.543052Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T13:44:53.543053Z info FLAG: --outlierLogPath="" 2026-11-03T13:44:53.543055Z info FLAG: --profiling="true" 2026-11-03T13:44:53.543057Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T13:44:53.543059Z info FLAG: --proxyLogLevel="warning" 2026-11-03T13:44:53.543061Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T13:44:53.543063Z info FLAG: --stsPort="0" 2026-11-03T13:44:53.543064Z info FLAG: --templateFile="" 2026-11-03T13:44:53.543066Z info FLAG: --tokenManagerPlugin="" 2026-11-03T13:44:53.543068Z info FLAG: --vklog="0" 2026-11-03T13:44:53.543071Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T13:44:53.543197Z info Proxy role ips=[10.133.0.25] type=router id=maas-default-gateway-openshift-default-855f9574cf-q84ws.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T13:44:53.543234Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T13:44:53.544293Z info cpu limit detected as 2, setting concurrency 2026-11-03T13:44:53.544513Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T13:44:53.544525Z info JWT policy is third-party-jwt 2026-11-03T13:44:53.544527Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T13:44:53.546463Z info Starting default Istio SDS Server 2026-11-03T13:44:53.546485Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T13:44:53.546500Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T13:44:53.546843Z info Opening status port 15020 2026-11-03T13:44:53.547726Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T13:44:53.548385Z info sds Starting SDS grpc server 2026-11-03T13:44:53.548398Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T13:44:53.549099Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T13:44:53.549813Z info Starting proxy agent 2026-11-03T13:44:53.549843Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T13:44:53.610615Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T13:44:53.671622Z info cache generated new workload certificate resourceName=default latency=123.046563ms ttl=23h59m59.328381492s 2026-11-03T13:44:53.671654Z info cache Root cert has changed, start rotating root cert 2026-11-03T13:44:53.671681Z info cache returned workload trust anchor from cache ttl=23h59m59.328319128s 2026-11-03T13:44:53.760031Z info ads ADS: new connection for node:1 2026-11-03T13:44:53.760099Z info cache returned workload certificate from cache ttl=23h59m59.239903486s 2026-11-03T13:44:53.760292Z info ads ADS: new connection for node:2 2026-11-03T13:44:53.760350Z info cache returned workload trust anchor from cache ttl=23h59m59.239650902s 2026-11-03T13:44:53.840838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:45:01.566915Z info Readiness succeeded in 8.026462043s 2026-11-03T13:45:01.567296Z info Envoy proxy is ready 2026-11-03T13:51:08.471157Z info ads ADS: new connection for node:3 2026-11-03T13:51:08.477663Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T13:51:08.477713Z info cache read certificate from file resource=file-root:system 2026-11-03T13:51:13.352367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:51:18.238808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:51:28.005056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:51:30.521754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:51:30.521800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:51:30.521818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:51:30.521825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T13:51:30.380Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 140 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a04a7ba6-2425-479f-839d-bcd91c94d6d1" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:58626 10.133.0.25:443 10.132.0.14:54518 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:51:38.055950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:51:38.055984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:51:38.055994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:51:38.055998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:51:38.056162Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T13:51:37.974Z] "POST /llm/e2e-rt-sw-5dc86c/anything/e2e-rt-sw-5dc86c-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 81 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "79d954bd-1a2e-46bf-af95-9aa848d1241f" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-5dc86c.llm.svc.cluster.local - 10.133.0.25:443 10.132.0.14:40768 - llm.external-model-e2e-rt-sw-5dc86c-f7b2c3e076e2.2 2026-11-03T13:51:40.618395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:16.158240Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:52:41.380451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:52:41.380498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:52:41.380508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T13:52:41.380512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T13:52:41.380688Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T13:52:41.248Z] "POST /anything/e2e-rt-sw-5dc86c-client HTTP/1.1" 200 - via_upstream - "-" 124 1772 132 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0765d294-9500-43ec-92a5-91da57ecd5cf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:44818 10.133.0.25:443 10.132.0.14:56620 - llm.external-model-e2e-rt-sw-5dc86c-f7b2c3e076e2.0 2026-11-03T13:53:13.673780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:53:16.792371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:53:16.792415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:53:16.792436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:53:16.792442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T13:53:16.626Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 165 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "7f9e04bf-b2ab-4df2-92e6-3a9e9f79457e" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:34236 10.133.0.25:443 10.132.0.14:58120 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:56:18.697923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:56:46.797440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:57:14.047431Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T13:57:15.407978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:57:20.149206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:57:51.398384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:58:42.801015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:00:45.095478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:45.095511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:45.095525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T14:00:45.095530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:45.692344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:45.692379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:45.692393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:00:45.692397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T14:00:44.920Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 175 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "3f53d197-a580-476d-8988-196375fe58c0" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:40704 10.133.0.25:443 10.132.0.14:39942 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T14:00:45.542Z] "DELETE /v1/api-keys/8874e1cf-72c5-4f18-b0cd-2c96d855e175 HTTP/1.1" 200 - via_upstream - "-" 0 370 149 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "d1e32fed-e146-4376-bbfe-8373e6bf0a93" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:40704 10.133.0.25:443 10.132.0.14:39948 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:00:55.893530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:00:55.893613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:00:55.893633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T14:00:55.893639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T14:00:55.659Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 234 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "30aebf01-af78-4ac7-85bd-2335577a7d3f" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:58648 10.133.0.25:443 10.132.0.14:58252 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T14:01:23.834940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:01:50.718345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:12:32.025854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T14:12:32.025931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:12:32.025947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:12:32.025964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:12:32.025968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T14:12:31.890Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 135 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0db3ff64-ad55-4330-95d8-a23582796ea3" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:43440 10.133.0.25:443 10.132.0.14:56208 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T14:12:32.627Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 323 74 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5777e512-209b-4eb9-9d0c-b77c4d56569c" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:56142 10.133.0.25:443 10.132.0.14:56224 - v1-chat-completions-path 2026-11-03T14:13:55.213174Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T14:14:40.937157Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T14:16:48.095289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:16:48.095326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:16:48.095342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:16:48.095347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T14:16:47.977Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 117 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "32adee73-1d0a-4aeb-90b9-d76194ff9685" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:50126 10.133.0.25:443 10.132.0.14:48366 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T14:16:48.619Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 373 78 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "30a12bc5-de81-461c-8b67-ef75f20e7756" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:48884 10.133.0.25:443 10.132.0.14:48374 - v1-chat-completions-path 2026-11-03T14:18:20.398819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:18:20.398857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:18:20.398873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:18:20.398878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T14:18:20.276Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 122 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "41f16d1d-fd7f-436d-8643-bad71a8f2d0c" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:49952 10.133.0.25:443 10.132.0.14:51196 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T14:31:11.357Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 9 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "931c8f3c-7228-4f24-bb55-b98ef08ec941" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.25:443 10.132.0.14:41988 - - 2026-11-03T14:37:52.388194Z info ads ADS: new connection for node:4 2026-11-03T14:37:52.393310Z info cache read certificate from file resource=file-root:system 2026-11-03T14:37:56.135606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:38:29.093578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:38:39.379598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:38:39.379632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:38:39.379645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:38:39.379650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T14:38:39.663744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T14:38:39.729672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:38:39.729702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:38:39.729714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T14:38:39.729719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:38:39.729894Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T14:38:39.194Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 184 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "6bf2f61f-2fd4-4904-b248-641df9d4326b" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:59200 10.133.0.25:443 10.132.0.14:50142 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T14:38:39.582Z] "POST /anything/e2e-dft-1ac9fc-cc3c68 HTTP/1.1" 200 - via_upstream - "-" 109 1775 147 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "2476561a-f0d4-47d3-bf83-7874e64ee645" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:55460 10.133.0.25:443 10.132.0.14:50154 - llm.external-model-e2e-dft-1ac9fc-366a77a093ef.0 2026-11-03T14:38:40.463480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:38:40.463511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:38:40.463523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T14:38:40.463529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T14:38:40.463724Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T14:38:40.351Z] "POST /anything/e2e-dft-1ac9fc-cc3c68 HTTP/1.1" 200 - via_upstream - "-" 109 1774 112 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a956ef93-f72b-47e0-ab39-43ca444abdd4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:55460 10.133.0.25:443 10.132.0.14:50162 - llm.external-model-e2e-dft-1ac9fc-366a77a093ef.0 [2026-11-03T14:38:40.682Z] "POST /llm/e2e-dft-1ac9fc/anything/e2e-dft-1ac9fc-cc3c68 HTTP/1.1" 401 - - "-" 109 88 201 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "7ebeb9b7-7e8f-410a-9a84-82267772b8eb" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-1ac9fc.llm.svc.cluster.local - 10.133.0.25:443 10.132.0.14:50168 - llm.external-model-e2e-dft-1ac9fc-366a77a093ef.2 2026-11-03T14:38:41.208502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:38:41.208530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:38:41.208574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T14:38:41.208579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T14:38:41.208723Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T14:38:41.082Z] "POST /anything/e2e-dft-1ac9fc-cc3c68 HTTP/1.1" 200 - via_upstream - "-" 109 1774 126 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "2b69f1b6-5949-4c16-8f7d-e8151217bac1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:55468 10.133.0.25:443 10.132.0.14:50174 - llm.external-model-e2e-dft-1ac9fc-366a77a093ef.0 2026-11-03T14:38:53.677253Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T14:38:54.660820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:38:56.863856Z info ads ADS: new connection for node:5 2026-11-03T14:38:56.875796Z info cache read certificate from file resource=file-root:system 2026-11-03T14:39:01.077681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:39:02.784257Z info ads ADS: "" 5 terminated 2026-11-03T14:39:05.032308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:39:09.563759Z info ads ADS: new connection for node:6 2026-11-03T14:39:09.568222Z info cache read certificate from file resource=file-root:system 2026-11-03T14:39:12.100661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:39:15.911569Z info ads ADS: "" 6 terminated 2026-11-03T14:39:16.767357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:39:18.691887Z info ads ADS: new connection for node:7 2026-11-03T14:39:18.697513Z info cache read certificate from file resource=file-root:system 2026-11-03T14:39:23.259965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:39:25.211584Z info ads ADS: "" 7 terminated with stream closed 2026-11-03T14:39:26.849025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:39:35.682207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:40:24.770006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:44:12.593795Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-11-03T14:46:52.438392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:48:13.803281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:49:05.851969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T14:50:39.987509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:07:06.162255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:07:06.162289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:07:06.162303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:07:06.162307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T15:07:05.983Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 178 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "bf872276-bf2d-4fed-b7e5-f2ff7f582b55" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:44954 10.133.0.25:443 10.132.0.14:44270 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:07:09.121113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:07:11.773257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:07:11.773291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:07:11.773304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:07:11.773309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T15:07:11.665Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 108 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a50f22b2-fe6a-42a5-bb64-d69a8eb97120" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:44966 10.133.0.25:443 10.132.0.14:44280 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:07:37.426685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:14.149070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:08:17.305Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 147 412 124 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b09e6c8d-cc86-4f66-a92e-6531c6fad8ff" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:37648 10.133.0.25:443 10.132.0.14:40244 - v1-chat-completions-path [2026-11-03T15:08:17.963Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 411 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "66b9dd51-9ff6-4166-97dc-ccad88d3c385" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:37656 10.133.0.25:443 10.132.0.14:40250 - v1-chat-completions-path [2026-11-03T15:08:18.767Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 65 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5ff19fcc-7021-4ccf-94d0-2f569253f054" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:37648 10.133.0.25:443 10.132.0.14:40254 - v1-chat-completions-path 2026-11-03T15:08:33.875888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:38.729206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:08:42.017442Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T15:08:41.936Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 81 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a6f07e1a-d7f4-4510-b5f5-604697ca6c0a" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:39080 10.133.0.25:443 10.132.0.14:35342 - v1-catch-all-model-routing 2026-11-03T15:08:48.336804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:09:01.809257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:09:11.049149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:09:13.251430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:09:13.251471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:09:13.251490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:09:13.251497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T15:09:13.025Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 225 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "d96a4bb2-612f-476a-ad3b-4d367c8c9f47" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:50952 10.133.0.25:443 10.132.0.14:35170 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:09:27.553425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:09:39.225021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:09:42.794890Z info ads ADS: new connection for node:8 2026-11-03T15:09:42.795094Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T15:09:42.795199Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T15:09:46.293294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:10:30.631920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:10:55.444682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:10:55.464365Z info ads ADS: "" 8 terminated 2026-11-03T15:11:00.167512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:11:00.167573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:11:00.167588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:11:00.167592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T15:11:00.415023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:11:00.045Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 332 122 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "af854f46-857a-47ff-a309-e0ee0040cf22" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:46136 10.133.0.25:443 10.132.0.14:33436 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:11:14.335548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:13:52.586771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:02.897172Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=5 2026-11-03T15:14:23.141016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:14:54.364175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:09.850060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:21.992976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:15:36.579419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:15:40.602Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 68 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5cac1239-6a8c-4e37-9b90-a071ad848721" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:38218 - v1-completions-path [2026-11-03T15:15:41.937Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "ebeee509-f8b6-458d-bc44-5ec7d3243a78" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:38228 - v1-completions-path 2026-11-03T15:15:43.765660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:15:43.768Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 100 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "7c328aa6-901c-435a-a97c-3d61c63c8d47" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:38234 - v1-completions-path [2026-11-03T15:15:46.945Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "9225bab9-5dcf-403a-8fe9-2e8fa433a87a" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:33442 - v1-completions-path 2026-11-03T15:16:01.809774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:16:04.865Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 67 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "4b7fb8dc-b284-40df-aedf-0371ab2223ea" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:40832 10.133.0.25:443 10.132.0.14:52438 - v1-completions-path 2026-11-03T15:16:52.323007Z info ads ADS: new connection for node:9 2026-11-03T15:16:52.330178Z info cache read certificate from file resource=file-root:system 2026-11-03T15:16:56.749212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:16:58.036220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:33.824576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:33.824611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:33.824628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:33.824634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T15:17:33.824818Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T15:17:33.700Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 123 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f8710e02-6a45-4031-bcb1-5232f5cb0b40" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:43280 10.133.0.25:443 10.132.0.14:50592 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:17:39.171779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:39.171809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:39.171819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:17:39.171823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:39.171966Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T15:17:36.026Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 3145 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f9b52ffe-2732-4713-b712-a352a2068fe6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:56760 10.133.0.25:443 10.132.0.14:50522 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:17:43.787134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:43.787166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:43.787175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:43.787179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T15:17:43.787306Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T15:17:43.683Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 103 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "7b196d67-8fba-4d9c-8aec-ecb609fe260a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:43280 10.133.0.25:443 10.132.0.14:50554 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:17:57.670555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:57.670582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:57.670591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:17:57.670595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T15:17:57.670746Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T15:17:57.563Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 107 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "383e5b4a-1e41-41a9-9207-88179f9bc531" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:43280 10.133.0.25:443 10.132.0.14:35014 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:18:16.322799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:18:16.322833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:18:16.322842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:18:16.322846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:18:16.322992Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T15:18:16.212Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 110 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "02619297-146b-4566-831f-305fcc8323a2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.25:56760 10.133.0.25:443 10.132.0.14:40998 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:18:52.682632Z info ads ADS: "" 9 terminated 2026-11-03T15:18:52.725628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:18:56.253700Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:18:56.253722Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:18:56.253725Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:18:56.253729Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T15:18:56.216Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 37 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "af372674-d820-420a-a4aa-9ffb60e16b10" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.25:443 10.132.0.14:57464 - v1-completions-path 2026-11-03T15:18:57.042911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:19:05.670223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:19:21.522985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:19:26.270085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:19:29.225Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 68 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "63ca05c4-e326-4766-9ad2-d4f80cfc93f7" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:53396 - v1-completions-path 2026-11-03T15:19:46.235195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:20:03.307492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:20:09.788117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:20:09.788153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:20:09.788167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T15:20:09.788171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T15:20:09.673Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 114 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f85d3c25-f0da-48ea-8a6f-6fdb229607af" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.25:34554 10.133.0.25:443 10.132.0.14:43014 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T15:20:10.721Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 66 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "707dddc0-ebde-41f3-95e1-b3e5049cff4c" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:43028 - v1-completions-path [2026-11-03T15:20:11.449Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "00181451-3dfc-4660-942a-449e1198f0df" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:43044 - v1-completions-path [2026-11-03T15:20:11.811Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 55 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "beee5120-92a7-4228-905a-3386e78e7391" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:43046 - v1-completions-path [2026-11-03T15:20:12.162Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "bc1ef6ba-a8dd-4682-9cf8-8273af16152c" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.25:443 10.132.0.14:43058 - v1-completions-path [2026-11-03T15:20:13.483Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f2f18f04-d5f8-4e18-a504-5a39170d83ec" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:43070 - v1-completions-path [2026-11-03T15:20:13.994Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "71244f4a-6abf-4233-ae19-9cd6dbbd9c4d" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:51424 - v1-completions-path [2026-11-03T15:20:14.524Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "6d6b9252-cbb3-4f01-a844-90e134b5a875" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:51432 - v1-completions-path 2026-11-03T15:20:34.460718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:20:45.318965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:20:51.912126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:21:05.711107Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy [2026-11-03T15:21:05.555Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "314213fe-ec4d-4632-954f-d362bfc81235" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:45584 - v1-completions-path [2026-11-03T15:21:09.187Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "09101d63-061a-4d76-952d-4d84aaa037c5" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:45598 - v1-completions-path [2026-11-03T15:21:09.447Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0eda4f00-68e2-4ea5-9cd5-0798f0511b61" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:45616 - v1-completions-path 2026-11-03T15:21:23.222174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:21:28.089563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:21:41.785904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:21:50.847902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:21:58.946469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:22:08.132077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:22:16.254632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:22:21.430Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 65 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "acf198f0-05f8-46c1-ab31-13f7e40a4540" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:39472 10.133.0.25:443 10.132.0.14:45632 - v1-completions-path 2026-11-03T15:22:36.937791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:22:51.354Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "33e6a8a3-dc56-490c-a4b2-b36f2c4ef3d0" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.25:443 10.132.0.14:45900 - v1-completions-path 2026-11-03T15:23:08.632835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:23:31.874485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:23:42.588176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:23:57.778Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 34 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f2ce77c7-784a-4459-b7b9-d46321b2ce1d" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.25:443 10.132.0.14:40978 - v1-completions-path 2026-11-03T15:28:35.656395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:28:38.155Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 289 280 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5a356271-1077-430f-81cf-fdbc102694bd" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:54508 10.133.0.25:443 10.132.0.14:58442 - v1-completions-path 2026-11-03T15:28:52.967069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:28:59.452293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:29:03.098219Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:29:03.098246Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:29:03.098249Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:29:03.098253Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T15:29:03.062Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 35 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "c9daf1ad-86da-4b02-9239-12d1ffa1efc6" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.25:443 10.132.0.14:41638 - v1-completions-path 2026-11-03T15:29:14.185096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:29:29.624917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:29:34.748823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:29:38.081Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 78 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "287b9880-69ea-4e41-b359-33507d973975" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:51540 - v1-completions-path 2026-11-03T15:29:54.660892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:30:05.436771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:30:11.829860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:30:26.814Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 55 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "30ce93ec-82a2-4188-95ca-9ceb016d2505" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:46624 - v1-completions-path 2026-11-03T15:30:42.042062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:30:48.472631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:30:54.623086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:31:00.446Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "35543e05-f6d5-4d16-ac81-5ea7bcf30de2" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:56466 - v1-completions-path [2026-11-03T15:31:00.714Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 54 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "45730933-e961-4b82-bbf8-ad52a71027a6" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58488 10.133.0.25:443 10.132.0.14:56480 - v1-completions-path [2026-11-03T15:31:09.377Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f70cbc0b-f5e4-4886-aa8d-a8675d439cb2" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.25:443 10.132.0.14:55930 - v1-completions-path 2026-11-03T15:31:23.648196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:31:34.364079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:31:39.512695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:31:45.967259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:31:54.318029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:32:01.563Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 67 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f3d6d4cc-cf0c-4433-a02f-b4c892a32af0" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:32938 - v1-completions-path [2026-11-03T15:32:02.704Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "3e5622ae-8a81-4fad-af83-2a26be227d94" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:58484 10.133.0.25:443 10.132.0.14:32940 - v1-completions-path 2026-11-03T15:32:17.416734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:32:28.392707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:32:33.359214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:32:51.640150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:32:58.086124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:33:19.560583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:33:39.445674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:33:50.447165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:34:01.334426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:34:12.166960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:34:23.294165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:34:34.041584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:34:46.136580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:34:56.048502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:35:06.491420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:35:17.153352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:35:27.413Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 108 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "fbf4cc67-18fb-4a7e-82e3-d0202b5dcfd2" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.25:40832 10.133.0.25:443 10.132.0.14:43690 - v1-completions-path