2026-10-31T12:51:22.944247Z info FLAG: --concurrency="0" 2026-10-31T12:51:22.944266Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T12:51:22.944270Z info FLAG: --help="false" 2026-10-31T12:51:22.944273Z info FLAG: --log_as_json="false" 2026-10-31T12:51:22.944275Z info FLAG: --log_caller="" 2026-10-31T12:51:22.944277Z info FLAG: --log_output_level="default:info" 2026-10-31T12:51:22.944279Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T12:51:22.944283Z info FLAG: --log_target="[stdout]" 2026-10-31T12:51:22.944285Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T12:51:22.944287Z info FLAG: --outlierLogPath="" 2026-10-31T12:51:22.944289Z info FLAG: --profiling="true" 2026-10-31T12:51:22.944291Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T12:51:22.944293Z info FLAG: --proxyLogLevel="warning" 2026-10-31T12:51:22.944294Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T12:51:22.944296Z info FLAG: --stsPort="0" 2026-10-31T12:51:22.944298Z info FLAG: --templateFile="" 2026-10-31T12:51:22.944300Z info FLAG: --tokenManagerPlugin="" 2026-10-31T12:51:22.944302Z info FLAG: --vklog="0" 2026-10-31T12:51:22.944305Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T12:51:22.944450Z info Proxy role ips=[10.133.0.47] type=router id=maas-default-gateway-openshift-default-fc8c56547-95zp2.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T12:51:22.944498Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T12:51:22.945564Z info cpu limit detected as 2, setting concurrency 2026-10-31T12:51:22.946130Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T12:51:22.946142Z info JWT policy is third-party-jwt 2026-10-31T12:51:22.946144Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T12:51:22.947484Z info Starting default Istio SDS Server 2026-10-31T12:51:22.947504Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T12:51:22.947527Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T12:51:22.947922Z info Opening status port 15020 2026-10-31T12:51:22.949208Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T12:51:22.949534Z info sds Starting SDS grpc server 2026-10-31T12:51:22.949548Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T12:51:22.950689Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T12:51:22.951459Z info Starting proxy agent 2026-10-31T12:51:22.951488Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T12:51:23.014290Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T12:51:23.132069Z info ads ADS: new connection for node:1 2026-10-31T12:51:23.132527Z info ads ADS: new connection for node:2 2026-10-31T12:51:23.246822Z info cache generated new workload certificate resourceName=default latency=297.115891ms ttl=23h59m59.753182001s 2026-10-31T12:51:23.246864Z info cache Root cert has changed, start rotating root cert 2026-10-31T12:51:23.246903Z info cache returned workload trust anchor from cache ttl=23h59m59.753098728s 2026-10-31T12:51:23.246915Z info cache returned workload certificate from cache ttl=23h59m59.753085226s 2026-10-31T12:51:23.247047Z info cache returned workload trust anchor from cache ttl=23h59m59.75295765s 2026-10-31T12:51:23.247271Z info cache returned workload trust anchor from cache ttl=23h59m59.752729985s 2026-10-31T12:51:23.335752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:51:31.197832Z info Readiness succeeded in 8.256066911s 2026-10-31T12:51:31.198145Z info Envoy proxy is ready 2026-10-31T12:54:12.643097Z info ads ADS: new connection for node:3 2026-10-31T12:54:12.648271Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T12:54:12.648390Z info cache read certificate from file resource=file-root:system 2026-10-31T12:54:13.131191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:20.005393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:28.928614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:43.673303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T12:54:43.944Z] "POST /llm/e2e-rt-sw-570c25/anything/e2e-rt-sw-570c25-client HTTP/1.1" 404 - - "-" 124 0 26 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "8acea556-6779-488a-9719-30de6c70c5f8" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-570c25.llm.svc.cluster.local - 10.133.0.47:443 10.132.0.13:52814 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.2 2026-10-31T12:55:13.667190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:23.332324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:55:23.332369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:55:23.332386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:55:23.332391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:55:23.332622Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T12:55:23.137Z] "POST /anything/e2e-rt-sw-570c25-client HTTP/1.1" 200 - via_upstream - "-" 124 1756 195 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7546c586-3377-414d-b1d0-4d2215260a92" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:60282 10.133.0.47:443 10.132.0.13:48134 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.0 2026-10-31T12:55:28.810957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:28.811111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:28.811131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:55:28.811136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:28.811352Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T12:55:28.634Z] "POST /anything/e2e-rt-sw-570c25-client HTTP/1.1" 200 - via_upstream - "-" 124 1764 177 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "34cd4abd-36b4-461f-98d2-3ab307d9ab32" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:45938 10.133.0.47:443 10.132.0.13:48160 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.0 2026-10-31T12:55:40.813926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:53.821573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:22.343811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:23.202380Z info ads ADS: "" 3 terminated with stream closed 2026-10-31T12:56:23.724161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:38.861804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:57:45.183383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:59:23.570323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:59:41.516631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:41.516697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:41.516719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:41.516727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T12:59:41.444Z] "DELETE /v1/api-keys/f380c414-cdd8-473e-8cc6-000caeec19cf HTTP/1.1" 200 - via_upstream - "-" 0 321 71 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "2f6335ab-f9f0-4b14-bc6b-4ca64c4197a7" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.47:39784 10.133.0.47:443 10.132.0.13:52436 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:42.200248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:42.200290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:42.200311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:42.200318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:59:42.137Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5c90bc8f-0742-4855-a68d-d99f6a0a8ae5" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.47:39784 10.133.0.47:443 10.132.0.13:52450 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:59:58.890Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 79 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1fcd16c8-1bc7-4d6c-a417-a4a92d117e11" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:37014 10.133.0.47:443 10.132.0.13:56532 - v1-completions-path 2026-10-31T13:00:08.159834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:00:28.463573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:13:42.996478Z info ads ADS: new connection for node:4 2026-10-31T13:13:43.007618Z info cache read certificate from file resource=file-root:system 2026-10-31T13:20:21.021155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:21:02.617906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:21:07.628090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:21:07.628121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:21:07.628130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:21:07.628134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:21:07.628326Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T13:21:07.179Z] "POST /anything/e2e-dft-ae53f1-c0af62 HTTP/1.1" 200 - via_upstream - "-" 109 1761 449 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "fe51d747-a6f5-4f1b-ac2e-06a1fec1a383" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:35640 10.133.0.47:443 10.132.0.13:49378 - llm.external-model-e2e-dft-ae53f1-cdfeffcac09d.0 2026-10-31T13:21:43.107225Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T13:22:05.741632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:22:24.796179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:03.865190Z info ads ADS: new connection for node:5 2026-10-31T13:23:03.865354Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:23:03.865378Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:23:22.402473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:40.175322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:24:05.566517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:26:41.796927Z info ads ADS: "" 5 terminated 2026-10-31T13:30:09.480954Z info ads ADS: "" 4 terminated 2026-10-31T13:33:39.006232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:35:24.940222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:36:51.168723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:37:32.767237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:38:49.176943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:40:35.522662Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-31T13:42:31.431404Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T13:48:00.826381Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:24.731818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:57.341878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:12.849090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:14.784209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:18.053363Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T13:49:17.981Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 71 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "56c36bfa-c6cc-442f-a9b4-218c1a732e71" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:46078 10.133.0.47:443 10.132.0.13:35212 - v1-catch-all-path 2026-10-31T13:49:20.840714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:35.952716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:37.708990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:43.570392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:02.829558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:04.545776Z info ads ADS: new connection for node:6 2026-10-31T13:50:04.546029Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:50:04.546078Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:50:06.143626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:46.866719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:05.842624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:05.961707Z info ads ADS: "" 6 terminated with stream closed 2026-10-31T13:51:07.732994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:10.095581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:14.294105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:53:23.940620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:53:23.940670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T13:53:23.940687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:53:23.940703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:53:23.940708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T13:53:23.887Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 53 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "2a344563-2c87-440e-b350-edd9353475e7" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.47:45528 10.133.0.47:443 10.132.0.13:37644 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:53:27.078929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:53:46.086717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:00.271304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:11.958059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:15.502203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:26.675132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:29.037878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:44.237800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:55:29.254730Z info ads ADS: new connection for node:7 2026-10-31T13:55:29.260030Z info cache read certificate from file resource=file-root:system 2026-10-31T13:55:29.870915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:55:31.452070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:55:45.375935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:55:45.375968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:55:45.375980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:55:45.375984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:55:45.376147Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T13:55:45.242Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1700 133 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "39152474-7c60-455d-9af9-4b3e4474bd1a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:49276 10.133.0.47:443 10.132.0.13:32836 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:55:51.869667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-31T13:55:51.940723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:55:51.940755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:55:51.940767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:55:51.940772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:55:51.940941Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T13:55:51.807Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1697 133 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "92b219e5-3e89-41b9-833a-f1739910d6d9" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:49282 10.133.0.47:443 10.132.0.13:32866 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:56:05.031402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:05.031440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:05.031453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:56:05.031457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:05.031612Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T13:56:04.933Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1705 97 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9ecce162-eab4-470a-b0ff-b695bccc8cce" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:49282 10.133.0.47:443 10.132.0.13:40646 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:56:35.466010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:35.466046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:35.466059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:56:35.466063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:35.466238Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T13:56:35.371Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1700 95 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6e3eb556-a608-4edb-a0f9-42436aacf537" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:49276 10.133.0.47:443 10.132.0.13:39280 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:56:39.815142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:39.815186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:39.815203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:39.815208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:56:39.815413Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T13:56:39.711Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1705 104 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "b051c010-06f0-4ff2-b21d-acf48fac58e5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:49282 10.133.0.47:443 10.132.0.13:39304 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:56:52.772012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:52.772047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:52.772058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:56:52.772062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:52.772236Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T13:56:52.669Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1704 102 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ad93fd88-0ea7-4e58-b28e-d20096ad6469" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.47:49282 10.133.0.47:443 10.132.0.13:51032 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:57:07.901616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:08.062083Z info ads ADS: "" 7 terminated with stream closed 2026-10-31T13:57:08.475730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:11.099599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:13.385594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:57:16.248Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 73 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "4447b4b7-bdcd-93b2-beab-b7a21c86b224" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:42206 10.133.0.47:443 10.132.0.13:43130 - v1-completions-path [2026-10-31T13:57:17.018Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "fdb6b65b-2ee4-4631-a9f7-adc533d0850e" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:42206 10.133.0.47:443 10.132.0.13:43136 - v1-completions-path 2026-10-31T13:57:28.774147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:30.430318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:44.994706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:46.751070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:49.407248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:57.853057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:03.739935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:58:03.739973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:58:03.739990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:58:03.739995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T13:58:03.675Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 64 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c175f0e3-0720-46c5-8cc8-c078fda5a547" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.47:56934 10.133.0.47:443 10.132.0.13:44358 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:58:04.079Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9cb6a884-e263-4551-9992-292f981e0804" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:33780 10.133.0.47:443 10.132.0.13:44368 - v1-completions-path [2026-10-31T13:58:05.423Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "b15305f3-5233-4b05-9288-2337181d54e8" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:33780 10.133.0.47:443 10.132.0.13:44372 - v1-completions-path [2026-10-31T13:58:06.436Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c889757e-4229-4b92-a2ef-bbc8143c549b" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:42206 10.133.0.47:443 10.132.0.13:44392 - v1-completions-path 2026-10-31T13:58:22.238305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:32.533904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:36.398382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:58:39.042Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ae28fc6e-5fac-466c-b5a1-d935a0b61996" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:42206 10.133.0.47:443 10.132.0.13:41414 - v1-completions-path [2026-10-31T13:58:39.734Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "55871272-c65c-4b0e-bda2-bedbcb5e6206" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:42206 10.133.0.47:443 10.132.0.13:41422 - v1-completions-path [2026-10-31T13:58:40.117Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 111 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "cf69b6be-d57e-4ddc-925a-8ed7179e9822" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:33780 10.133.0.47:443 10.132.0.13:41432 - v1-completions-path [2026-10-31T13:58:40.865Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "05bc2350-35f1-41c1-a808-e330bb4e236e" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:42206 10.133.0.47:443 10.132.0.13:41456 - v1-completions-path 2026-10-31T13:58:52.474726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:54.120690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:59.614265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:10.476308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:24.224856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:25.930338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:31.334284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:49.547367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:52.048296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:07.204722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:09.348007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:14.152857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:28.975578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:39.226017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:54.981632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:57.282907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:03:12.403500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:03:14.723874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:39.546500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:43.078497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:04:43.078533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:04:43.078548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T14:04:43.078553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T14:04:43.017Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 61 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "b5ca01c4-15d4-461d-866c-43959a3580e5" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.47:33808 10.133.0.47:443 10.132.0.13:42412 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:04:54.614389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:56.273615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:02.038395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:20.630410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:24.535486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:05:28.464Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 78 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ce8939c5-eb1f-42cf-9264-6e43fd4e1e56" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:42206 10.133.0.47:443 10.132.0.13:59416 - v1-completions-path 2026-10-31T14:05:40.032047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:50.561964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:52.864053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:10.387378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:12.535185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:15.479163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:06:19.846Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 69 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5f7be095-2b70-440d-b297-23abdda25050" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:33780 10.133.0.47:443 10.132.0.13:56192 - v1-completions-path [2026-10-31T14:06:20.640Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "219ba6ee-0309-4003-b130-1ee61c51878a" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:33780 10.133.0.47:443 10.132.0.13:56194 - v1-completions-path [2026-10-31T14:06:23.481Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "52afcb15-b9f3-4144-9c4c-8be21171230a" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:33780 10.133.0.47:443 10.132.0.13:50570 - v1-completions-path [2026-10-31T14:06:23.911Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "8d7d94dd-0726-49da-abfb-b18ab76bdf3a" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:42206 10.133.0.47:443 10.132.0.13:50584 - v1-completions-path 2026-10-31T14:06:36.495190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:46.808624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:48.836887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:52.217301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:55.624235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:06:55.624273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:06:55.624293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:06:55.624298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T14:06:55.556Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 67 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ff8c68a3-09d0-44c5-accf-d0093c9b50f8" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.1.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.47:47138 10.133.0.47:443 10.132.0.13:44224 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:06:57.232673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:07:01.210Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "84445f61-f422-4963-bdfe-d781d6d7e9b6" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:33780 10.133.0.47:443 10.132.0.13:44236 - v1-completions-path 2026-10-31T14:07:13.295735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:23.559490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:25.171556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:35.405948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:38.286045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:41.564129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:58.597207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:18.457326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:28.740194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:38.969793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:49.140179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:59.495237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:09.744478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:19.878207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:30.114233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:40.323294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:50.585705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:09:57.958Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 44 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "d6138c79-1057-48c0-bf01-8daf58320584" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.47:443 10.132.0.13:54372 - v1-completions-path [2026-10-31T14:09:58.148Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 76 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e7edc541-7ce6-4e47-8d20-dce7ec0328fa" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.47:36226 10.133.0.47:443 10.132.0.13:54378 - v1-completions-path