2026-10-31T01:34:16.755716Z info FLAG: --concurrency="0" 2026-10-31T01:34:16.755735Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T01:34:16.755739Z info FLAG: --help="false" 2026-10-31T01:34:16.755742Z info FLAG: --log_as_json="false" 2026-10-31T01:34:16.755744Z info FLAG: --log_caller="" 2026-10-31T01:34:16.755746Z info FLAG: --log_output_level="default:info" 2026-10-31T01:34:16.755748Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T01:34:16.755752Z info FLAG: --log_target="[stdout]" 2026-10-31T01:34:16.755754Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T01:34:16.755756Z info FLAG: --outlierLogPath="" 2026-10-31T01:34:16.755758Z info FLAG: --profiling="true" 2026-10-31T01:34:16.755760Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T01:34:16.755763Z info FLAG: --proxyLogLevel="warning" 2026-10-31T01:34:16.755765Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T01:34:16.755767Z info FLAG: --stsPort="0" 2026-10-31T01:34:16.755768Z info FLAG: --templateFile="" 2026-10-31T01:34:16.755770Z info FLAG: --tokenManagerPlugin="" 2026-10-31T01:34:16.755773Z info FLAG: --vklog="0" 2026-10-31T01:34:16.755775Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T01:34:16.755917Z info Proxy role ips=[10.133.0.185] type=router id=maas-default-gateway-openshift-default-848f6bf8bc-btqmg.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T01:34:16.755963Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T01:34:16.757392Z info cpu limit detected as 2, setting concurrency 2026-10-31T01:34:16.757864Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T01:34:16.757888Z info JWT policy is third-party-jwt 2026-10-31T01:34:16.757892Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T01:34:16.760219Z info Starting default Istio SDS Server 2026-10-31T01:34:16.760240Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T01:34:16.760210Z info Opening status port 15020 2026-10-31T01:34:16.760256Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T01:34:16.760958Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T01:34:16.762750Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T01:34:16.763796Z info Starting proxy agent 2026-10-31T01:34:16.763835Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T01:34:16.771867Z info sds Starting SDS grpc server 2026-10-31T01:34:16.771886Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T01:34:16.838475Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T01:34:17.075278Z info ads ADS: new connection for node:1 2026-10-31T01:34:17.078693Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T01:34:17.078732Z info cache read certificate from file resource=file-root:system 2026-10-31T01:34:17.099578Z info cache generated new workload certificate resourceName=default latency=338.41252ms ttl=23h59m59.900424989s 2026-10-31T01:34:17.099606Z info cache Root cert has changed, start rotating root cert 2026-10-31T01:34:17.099642Z info cache returned workload trust anchor from cache ttl=23h59m59.900359021s 2026-10-31T01:34:17.111983Z info ads ADS: new connection for node:2 2026-10-31T01:34:17.112044Z info cache returned workload certificate from cache ttl=23h59m59.887958748s 2026-10-31T01:34:17.113655Z info ads ADS: new connection for node:3 2026-10-31T01:34:17.113955Z info cache returned workload trust anchor from cache ttl=23h59m59.886046909s 2026-10-31T01:34:17.206789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:34:25.234124Z info Readiness succeeded in 8.480588869s 2026-10-31T01:34:25.234455Z info Envoy proxy is ready [2026-10-31T01:34:33.807Z] "POST /llm/e2e-dft-952cf2/anything/e2e-dft-952cf2-0b2a8c HTTP/1.1" 503 - - "-" 109 0 85 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "c1b030c0-5c10-478b-bd33-089a90e41483" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-952cf2.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:42548 - llm.external-model-e2e-dft-952cf2-1e8b97967fa8.2 [2026-10-31T01:35:26.984Z] "POST /llm/e2e-dft-952cf2/anything/e2e-dft-952cf2-0b2a8c HTTP/1.1" 503 - - "-" 109 0 70 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9ae5de99-c24b-414c-8c67-9a92c9494577" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-952cf2.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:56846 - llm.external-model-e2e-dft-952cf2-1e8b97967fa8.2 [2026-10-31T01:35:37.542Z] "POST /llm/e2e-dft-952cf2/anything/e2e-dft-952cf2-0b2a8c HTTP/1.1" 503 - - "-" 109 0 78 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "57e10504-aec8-4ef6-a0ec-d3058625f987" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-952cf2.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:54416 - llm.external-model-e2e-dft-952cf2-1e8b97967fa8.2 [2026-10-31T01:36:52.039Z] "POST /llm/e2e-dft-952cf2/anything/e2e-dft-952cf2-0b2a8c HTTP/1.1" 503 - - "-" 109 0 76 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "6e987217-4f8c-444b-b6fc-bd24113ab463" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-952cf2.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:35918 - llm.external-model-e2e-dft-952cf2-1e8b97967fa8.2 [2026-10-31T01:37:18.611Z] "POST /llm/e2e-dft-952cf2/anything/e2e-dft-952cf2-0b2a8c HTTP/1.1" 503 - - "-" 109 0 69 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "76622499-1ac0-4eb4-afa5-75e6d769a52b" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-952cf2.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:59800 - llm.external-model-e2e-dft-952cf2-1e8b97967fa8.2 [2026-10-31T01:37:45.095Z] "POST /llm/e2e-dft-952cf2/anything/e2e-dft-952cf2-0b2a8c HTTP/1.1" 503 - - "-" 109 0 68 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "d760bae9-1d96-462e-9127-2adc7b274085" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-952cf2.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:42924 - llm.external-model-e2e-dft-952cf2-1e8b97967fa8.2 2026-10-31T01:37:52.132319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:38:26.415753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:38:57.986959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T01:39:30.498Z] "POST /llm/e2e-dft-b849cb/anything/e2e-dft-b849cb-d2fac1 HTTP/1.1" 403 - - "-" 109 77 42 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ada68277-b93e-4961-bfd9-c76065fb0ec3" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-b849cb.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:52568 - llm.external-model-e2e-dft-b849cb-66b606e53783.2 2026-10-31T01:40:26.482550Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T01:41:26.358Z] "POST /llm/e2e-dft-b849cb/anything/e2e-dft-b849cb-d2fac1 HTTP/1.1" 403 - - "-" 109 77 45 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "098c518d-45b2-4925-8bde-9a884a65e4fd" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-b849cb.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:57772 - llm.external-model-e2e-dft-b849cb-66b606e53783.2 [2026-10-31T01:42:18.773Z] "POST /llm/e2e-dft-b849cb/anything/e2e-dft-b849cb-d2fac1 HTTP/1.1" 403 - - "-" 109 77 42 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "c41db8d0-4395-46c1-942c-af85842d637e" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-b849cb.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:54394 - llm.external-model-e2e-dft-b849cb-66b606e53783.2 [2026-10-31T01:42:50.222Z] "POST /llm/e2e-dft-b849cb/anything/e2e-dft-b849cb-d2fac1 HTTP/1.1" 403 - - "-" 109 77 41 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "57612f91-8cab-4ce7-a323-0a2133f8a6bc" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-b849cb.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:41290 - llm.external-model-e2e-dft-b849cb-66b606e53783.2 [2026-10-31T01:43:00.721Z] "POST /llm/e2e-dft-b849cb/anything/e2e-dft-b849cb-d2fac1 HTTP/1.1" 403 - - "-" 109 77 41 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "8f2c91d1-6c88-4f43-b82e-2b329a0abf75" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-b849cb.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:39536 - llm.external-model-e2e-dft-b849cb-66b606e53783.2 2026-10-31T01:43:13.548256Z info ads ADS: "" 1 terminated 2026-10-31T01:43:14.523742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:43:39.124006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T01:45:22.947571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:00:52.283523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:00:52.283557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:00:52.283571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T02:00:52.283576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T02:00:52.096Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 187 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4779db05-d561-42d8-b8bb-dc80e6b43454" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:56720 10.133.0.185:443 10.132.0.9:33306 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T02:00:57.507164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:00:57.507206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:00:57.507225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T02:00:57.507231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T02:00:57.395Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 112 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1228d93a-50c8-4152-8743-85c0002022e9" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:56726 10.133.0.185:443 10.132.0.9:42462 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T02:00:59.955677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:01:25.408715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:01:35.378897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:01:35.378929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:01:35.378939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T02:01:35.378944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T02:01:35.264Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 114 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ebfa8c9d-4254-4b69-83fd-1f52083833d0" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:56720 10.133.0.185:443 10.132.0.9:37084 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T02:01:53.897255Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T02:02:02.967730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:02:21.713936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:02:26.360731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:02:29.538610Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T02:02:29.460Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 77 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "8f0fd50f-177d-48c4-9e70-8875a148fa52" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:40496 10.133.0.185:443 10.132.0.9:56864 - v1-catch-all-path 2026-10-31T02:02:36.341060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:02:50.164701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:03:00.413243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:03:03.057728Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T02:03:02.965Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 92 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5af93e31-06c6-43e6-bb91-59e52f45c798" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:40496 10.133.0.185:443 10.132.0.9:55976 - v1-catch-all-path 2026-10-31T02:03:16.753461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:03:28.337465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:03:30.989892Z info ads ADS: new connection for node:4 2026-10-31T02:03:30.990048Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T02:03:30.990073Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T02:03:33.332625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:04:19.561262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:04:43.521129Z info ads ADS: "" 4 terminated with stream closed 2026-10-31T02:04:43.793602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:04:48.617881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:05:05.545077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:07:18.598181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T02:07:18.613775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:07:18.613809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:07:18.613823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:07:18.613827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T02:07:18.493Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 120 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "c9f829c1-059f-4717-b02e-732bff2dae53" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:58508 10.133.0.185:443 10.132.0.9:55262 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T02:07:41.357669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:08:11.367606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:08:38.899250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:08:38.899285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:08:38.899299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:08:38.899304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T02:08:39.170693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:08:39.170732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:08:39.170750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:08:39.170755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T02:08:38.783Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 116 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "00c4046a-973d-4956-a776-f464e937f10b" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:43096 10.133.0.185:443 10.132.0.9:35470 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T02:08:39.100Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 70 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e453239b-ecfa-422f-ac4d-c1dca6da6fea" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:43104 10.133.0.185:443 10.132.0.9:35486 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T02:08:41.319112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:08:53.249682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:08:59.415323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:09:15.358327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:09:26.520718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:09:32.661385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T02:09:35.808Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 75 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a5f441fc-6bfb-4ee6-917e-b8b9a5a4eaaf" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:57932 10.133.0.185:443 10.132.0.9:47514 - v1-completions-path 2026-10-31T02:09:52.046145Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:10:39.916257Z info ads ADS: new connection for node:5 2026-10-31T02:10:39.922826Z info cache read certificate from file resource=file-root:system 2026-10-31T02:10:43.845196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:10:44.905395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:10:59.420152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:10:59.420188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:10:59.420203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T02:10:59.420209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:10:59.420392Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T02:10:59.256Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 163 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1790ed4a-70b6-4a07-b550-12a1f2f13ab2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.185:33352 10.133.0.185:443 10.132.0.9:54246 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T02:11:10.994532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:11:10.994560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:11:10.994570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T02:11:10.994574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:11:10.994713Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T02:11:10.868Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 126 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f8d1f65a-9560-4a9c-9c11-d4e26603effb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.185:60352 10.133.0.185:443 10.132.0.9:54628 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T02:11:13.304863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:11:13.304893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:11:13.304902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:11:13.304906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T02:11:13.305064Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T02:11:13.193Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 111 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "19e8346d-fc30-4620-96bd-dd44de00ce3b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.185:60352 10.133.0.185:443 10.132.0.9:54632 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T02:12:02.091941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:12:02.091977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:12:02.091990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T02:12:02.091995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:12:02.092200Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T02:12:01.979Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1709 112 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1ab40c78-c2d2-4096-a733-bc9a8ab834d1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.185:60352 10.133.0.185:443 10.132.0.9:53034 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T02:12:17.335553Z info ads ADS: "" 5 terminated 2026-10-31T02:12:17.378919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:12:17.932984Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T02:12:17.933006Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T02:12:17.933009Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T02:12:17.933013Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T02:12:17.899Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 33 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "180f4e96-420d-4635-9d9f-7671bd0ce2b4" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:42198 - v1-completions-path 2026-10-31T02:12:19.928104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:12:30.509173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:12:48.854212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:12:53.592721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:12:56.913725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T02:12:56.907Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "675d123a-4823-48b3-b407-637bebc921f7" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:52930 10.133.0.185:443 10.132.0.9:48104 - v1-completions-path 2026-10-31T02:13:00.230339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:13:00.230372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:13:00.230386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T02:13:00.230391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T02:13:00.169Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a69c4400-bfd9-4033-a326-079d4b050217" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:57932 10.133.0.185:443 10.132.0.9:48122 - v1-catch-all-path 2026-10-31T02:13:13.814772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:13:30.774945Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:13:37.337416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:13:37.337470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:13:37.337485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T02:13:37.337490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T02:13:37.223Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 114 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "c53a03f2-1d64-4d47-b9ee-99d2cb359637" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:40988 10.133.0.185:443 10.132.0.9:55578 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T02:13:39.367Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "02959b36-5c84-4ddd-96de-7d9476ac739c" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:52930 10.133.0.185:443 10.132.0.9:55608 - v1-completions-path 2026-10-31T02:14:01.649576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:14:12.484903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:14:18.813215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T02:14:30.422Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "237a880b-ef13-427b-8c4d-84016ac6b38e" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:57932 10.133.0.185:443 10.132.0.9:34982 - v1-completions-path [2026-10-31T02:14:33.277Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "d532a470-fcc8-489d-9d48-4b3c48838bf6" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:52930 10.133.0.185:443 10.132.0.9:34998 - v1-completions-path 2026-10-31T02:14:47.010782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:14:51.651026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T02:14:55.173Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 297 75 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "0ca66aca-5b15-424b-838b-82e740ceb5a9" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:53840 10.133.0.185:443 10.132.0.9:51156 - v1-completions-path 2026-10-31T02:15:05.148647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:15:15.233003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:15:25.876004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:15:32.360793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T02:15:45.019Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 82 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a6a2d5d3-c04e-4de1-a864-22f713cfa3d1" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:38892 10.133.0.185:443 10.132.0.9:43874 - v1-completions-path 2026-10-31T02:15:47.129275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:16:00.429471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:16:06.405454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:16:24.468810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:16:29.921942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:16:41.286593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:17:08.090138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:17:18.798329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:17:37.370640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:17:45.124248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:20:31.297038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:20:31.297071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:20:31.297084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T02:20:31.297089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T02:20:31.184Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 112 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5c9229c5-e015-41fc-aeb1-b8bdb3b11f3a" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:44782 10.133.0.185:443 10.132.0.9:33350 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T02:20:46.747764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:22:15.115905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:22:34.501688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:22:39.467277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:22:42.701661Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-31T02:22:52.457388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:23:09.082618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:23:14.039059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:23:16.602311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:23:16.602345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:23:16.602358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T02:23:16.602363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T02:23:16.390Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 211 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2248869a-ac2a-42de-a4eb-bab1ce313c8b" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.1.70:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.185:41208 10.133.0.185:443 10.132.0.9:58498 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T02:23:18.438Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4da89195-8252-4094-aa30-741573e0fec1" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:52930 10.133.0.185:443 10.132.0.9:39716 - v1-completions-path 2026-10-31T02:23:33.812038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:23:44.572322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:23:50.874317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:24:21.018817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:24:27.285469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:24:33.425178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T02:24:39.197Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "8c695cf6-b60e-42d8-93e4-cc8db826decd" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:57932 10.133.0.185:443 10.132.0.9:48200 - v1-completions-path [2026-10-31T02:24:44.704Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "329e5bae-43b2-4487-8b83-7bc2c47af2a7" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:57932 10.133.0.185:443 10.132.0.9:48214 - v1-completions-path [2026-10-31T02:24:48.350Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1382984a-e5c1-4d49-b416-379f4a4c942a" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.185:443 10.132.0.9:36354 - v1-completions-path 2026-10-31T02:25:02.660467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:25:13.373036Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:25:19.935066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:25:26.048389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:25:35.281120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T02:25:42.527Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "77379586-5e31-451c-a70b-2b19c2188664" "maas.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.185:57932 10.133.0.185:443 10.132.0.9:60488 - v1-completions-path 2026-10-31T02:25:58.212748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:26:08.889629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:26:13.816105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:26:31.620327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:26:39.544999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:27:01.846526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:27:23.814282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:27:43.981264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:27:54.821670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:28:05.834039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:28:16.656253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:28:27.496684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:28:38.353512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:28:49.090131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:28:59.674534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T02:29:37.040022Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3