2026-10-31T12:51:47.765671Z info FLAG: --concurrency="0" 2026-10-31T12:51:47.765691Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T12:51:47.765697Z info FLAG: --help="false" 2026-10-31T12:51:47.765700Z info FLAG: --log_as_json="false" 2026-10-31T12:51:47.765703Z info FLAG: --log_caller="" 2026-10-31T12:51:47.765706Z info FLAG: --log_output_level="default:info" 2026-10-31T12:51:47.765709Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T12:51:47.765715Z info FLAG: --log_target="[stdout]" 2026-10-31T12:51:47.765719Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T12:51:47.765722Z info FLAG: --outlierLogPath="" 2026-10-31T12:51:47.765726Z info FLAG: --profiling="true" 2026-10-31T12:51:47.765729Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T12:51:47.765732Z info FLAG: --proxyLogLevel="warning" 2026-10-31T12:51:47.765736Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T12:51:47.765739Z info FLAG: --stsPort="0" 2026-10-31T12:51:47.765741Z info FLAG: --templateFile="" 2026-10-31T12:51:47.765744Z info FLAG: --tokenManagerPlugin="" 2026-10-31T12:51:47.765748Z info FLAG: --vklog="0" 2026-10-31T12:51:47.765752Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T12:51:47.765939Z info Proxy role ips=[10.132.0.47] type=router id=maas-default-gateway-openshift-default-fc8c56547-vdjwd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T12:51:47.765995Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T12:51:47.767161Z info cpu limit detected as 2, setting concurrency 2026-10-31T12:51:47.767392Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T12:51:47.767406Z info JWT policy is third-party-jwt 2026-10-31T12:51:47.767410Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T12:51:47.769185Z info Starting default Istio SDS Server 2026-10-31T12:51:47.769211Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T12:51:47.769234Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T12:51:47.769613Z info Opening status port 15020 2026-10-31T12:51:47.770098Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T12:51:47.771325Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T12:51:47.772143Z info Starting proxy agent 2026-10-31T12:51:47.772173Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T12:51:47.780837Z info sds Starting SDS grpc server 2026-10-31T12:51:47.781021Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T12:51:47.843703Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T12:51:47.856855Z info cache generated new workload certificate resourceName=default latency=85.491493ms ttl=23h59m59.143147655s 2026-10-31T12:51:47.856886Z info cache Root cert has changed, start rotating root cert 2026-10-31T12:51:47.856917Z info cache returned workload trust anchor from cache ttl=23h59m59.143083862s 2026-10-31T12:51:47.965557Z info ads ADS: new connection for node:1 2026-10-31T12:51:47.965565Z info ads ADS: new connection for node:2 2026-10-31T12:51:47.965666Z info cache returned workload certificate from cache ttl=23h59m59.034336703s 2026-10-31T12:51:47.965686Z info cache returned workload trust anchor from cache ttl=23h59m59.034316087s 2026-10-31T12:51:48.080799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:51:56.364071Z info Readiness succeeded in 8.60167227s 2026-10-31T12:51:56.364507Z info Envoy proxy is ready 2026-10-31T12:54:12.622338Z info ads ADS: new connection for node:3 2026-10-31T12:54:12.629748Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T12:54:12.629856Z info cache read certificate from file resource=file-root:system 2026-10-31T12:54:13.180342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:20.013984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:28.931684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:32.436279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:54:32.436430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:54:32.436494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:54:32.436529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T12:54:32.251Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 185 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "23512d21-a4ad-4585-82c6-bd164f86c234" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:46316 10.132.0.47:443 10.132.0.13:43678 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:54:33.309158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:33.309265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:33.309297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:33.309318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:54:33.309550Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T12:54:33.128Z] "POST /anything/e2e-rt-sw-570c25-client HTTP/1.1" 200 - via_upstream - "-" 124 1756 181 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "74f785a2-2293-424f-898a-e7327d603958" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.47:49306 10.132.0.47:443 10.132.0.13:42776 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.0 2026-10-31T12:54:43.683410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:49.099085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:49.099128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:49.099142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:54:49.099149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:49.099363Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T12:54:49.034Z] "POST /llm/e2e-rt-sw-570c25/anything/e2e-rt-sw-570c25-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 65 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ed94ba7d-a1a3-4c37-a948-0370b14f3f99" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-570c25.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.13:33172 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.2 2026-10-31T12:55:00.474885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:55:00.474918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:55:00.474928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:55:00.474933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:55:00.475087Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-31T12:55:01.092018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:01.092051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:01.092062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:01.092067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:55:01.092231Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T12:55:00.332Z] "POST /anything/e2e-rt-sw-570c25-client HTTP/1.1" 200 - via_upstream - "-" 124 1740 143 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ca1ad817-d785-404e-895d-fe2551595c07" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.47:58772 10.132.0.47:443 10.132.0.13:56300 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.0 [2026-10-31T12:55:00.944Z] "POST /anything/e2e-rt-sw-570c25-client HTTP/1.1" 200 - via_upstream - "-" 124 1746 147 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1fc89745-3471-41f5-8e47-e3f3df039aff" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.47:58786 10.132.0.47:443 10.132.0.13:56310 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.0 2026-10-31T12:55:13.706999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:40.773515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:53.888784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:22.286286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:23.212374Z info ads ADS: "" 3 terminated 2026-10-31T12:56:23.816996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:38.947797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:57:45.214865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:59:23.595838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:59:40.109495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:40.109544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:40.109564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:40.109572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:59:40.039Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 69 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "899baea6-2c40-459b-a640-b06ae5d6b352" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:59956 10.132.0.47:443 10.132.0.13:59236 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:40.241347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:59:40.241385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:59:40.241403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:59:40.241410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:59:40.968166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:40.968200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:40.968214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:40.968218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:59:40.177Z] "DELETE /v1/api-keys/0f995a68-d64f-40e1-9954-8802c282e3fa HTTP/1.1" 200 - via_upstream - "-" 0 321 64 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "2dd93e5c-ce80-45ca-a5ba-928e59e78e70" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:59960 10.132.0.47:443 10.132.0.13:59252 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:59:40.897Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 70 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "aefe694c-2f5f-447d-804f-bcfa4ef4aa9d" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:59956 10.132.0.47:443 10.132.0.13:59258 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:44.825577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:44.825618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:44.825657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:44.825662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:59:44.764Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 61 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "351d0058-a6a0-4adb-a23c-f60fd365c159" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:59956 10.132.0.47:443 10.132.0.13:42236 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:00:08.165985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:00:28.442958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:07:27.033270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T13:07:27.115836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:07:27.115952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:07:27.115986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:07:27.115994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T13:07:27.017Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 98 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "3387f65d-0378-496f-a234-35acce075ce2" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:52596 10.132.0.47:443 10.132.0.13:58962 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:13:42.935105Z info ads ADS: new connection for node:4 2026-10-31T13:13:42.963212Z info cache read certificate from file resource=file-root:system 2026-10-31T13:20:20.943034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:21:02.697054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:22:05.831917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:22:24.901131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:03.898371Z info ads ADS: new connection for node:5 2026-10-31T13:23:03.898570Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:23:03.898596Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:23:11.319094Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T13:23:22.596246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:27.558906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-31T13:23:27.636008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:27.636041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:27.636050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:27.636055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:23:27.636218Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-31T13:23:27.905366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:27.905479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:27.905523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:23:27.905551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:27.905893Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T13:23:27.447Z] "POST /anything/e2e-dft-bf7ad6-aeb541 HTTP/1.1" 200 - via_upstream - "-" 109 1753 188 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "3a117552-5720-409f-ad64-c0363b9a045a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.47:44604 10.132.0.47:443 10.132.0.13:46504 - llm.external-model-e2e-dft-bf7ad6-4333c746aa58.0 [2026-10-31T13:23:27.748Z] "POST /anything/e2e-dft-07ef48-464c90 HTTP/1.1" 200 - via_upstream - "-" 109 1752 157 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7b10f254-70ea-4b5a-aa0f-051da117c08d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.47:44604 10.132.0.47:443 10.132.0.13:46506 - llm.external-model-e2e-dft-07ef48-b77f9f31caae.0 2026-10-31T13:23:40.391447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:24:05.661183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:26:41.835303Z info ads ADS: "" 5 terminated with stream closed 2026-10-31T13:30:09.751345Z info ads ADS: "" 4 terminated 2026-10-31T13:33:39.111720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:35:25.271170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:36:00.635068Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T13:36:51.200252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:37:32.725645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:38:49.246487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:40:01.071701Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-31T13:48:00.836441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:24.725400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:57.343949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:59.891819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:48:59.891856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:48:59.891871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:48:59.891876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T13:48:59.815Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 303 76 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "975a4bf9-9f68-4cb7-a123-235497cd1051" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:51136 10.132.0.47:443 10.132.0.13:36496 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:49:00.779Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 175 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "457339fa-d9de-402d-9db9-6bc013001cc5" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:49384 10.132.0.47:443 10.132.0.13:36498 - v1-chat-completions-path 2026-10-31T13:49:12.829901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:14.760914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:20.835663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:35.952441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:37.740358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:43.553514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:02.828947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:04.630680Z info ads ADS: new connection for node:6 2026-10-31T13:50:04.630866Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:50:04.630899Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:50:06.136839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:46.869966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:05.823819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:05.942472Z info ads ADS: "" 6 terminated with stream closed 2026-10-31T13:51:07.721878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:10.097893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:14.275241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:53:27.127767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:53:46.091009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:00.264332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:11.959472Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:15.501937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:26.674286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:29.038129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:44.201608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:55:14.118Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 76 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5b131fae-e127-4ea8-b0e9-a5c27eeab31e" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:36942 10.132.0.47:443 10.132.0.13:32804 - v1-completions-path 2026-10-31T13:55:29.244580Z info ads ADS: new connection for node:7 2026-10-31T13:55:29.247901Z info cache read certificate from file resource=file-root:system 2026-10-31T13:55:29.833152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:55:31.442590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:56:28.971213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:28.971251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:28.971267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:56:28.971272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:56:28.971456Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T13:56:28.840Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1695 131 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ce7e0b95-ad10-48da-9654-c67a649e598a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.47:53654 10.132.0.47:443 10.132.0.13:52708 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T13:56:56.703800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:56.703838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:56.703853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:56.703858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T13:56:56.627Z] "DELETE /v1/api-keys/0dcb5be5-dbd3-4ac5-8704-fa4fd7df1396 HTTP/1.1" 200 - via_upstream - "-" 0 359 76 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7cd80002-fe2e-4e5f-bba4-2b00f398e8e2" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:59136 10.132.0.47:443 10.132.0.13:55468 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:57:07.927135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:08.043548Z info ads ADS: "" 7 terminated 2026-10-31T13:57:08.467590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:11.156286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:13.399351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:28.779984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:30.420053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:44.993896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:46.771616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:49.495424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:57.852704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:58:04.732Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 85 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "0b3790fe-70cb-4b35-9362-7c0388f2f721" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:41692 10.132.0.47:443 10.132.0.13:33250 - v1-completions-path [2026-10-31T13:58:05.078Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7075e117-92cd-40b5-bcfa-1f040a943439" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:41708 10.132.0.47:443 10.132.0.13:33266 - v1-completions-path [2026-10-31T13:58:06.108Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 53 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "66f657c7-8637-46d1-b17f-49a3a4a5c3ed" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:41692 10.132.0.47:443 10.132.0.13:33288 - v1-completions-path 2026-10-31T13:58:22.232486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:32.530385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:36.400305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:52.437058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:54.110064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:59.617493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:10.480766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:24.223529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:25.949643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:31.321409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:49.532264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:52.217147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:07.214873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:09.342386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:14.170224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:28.976530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:39.219513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:54.967623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:57.277188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:03:12.438517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:03:14.718304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:39.550131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:54.617021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:56.268299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:59.369102Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T14:04:59.369129Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T14:04:59.369132Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T14:04:59.369136Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T14:04:59.333Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 35 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ebd4b3bf-d2ed-45d0-82e6-3edb9b128f28" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.13:51968 - v1-completions-path 2026-10-31T14:05:02.026175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:20.631049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:24.549609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:05:28.915Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "8c4933d9-0b3e-4bfb-8155-11223aae843d" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.13:60822 - v1-completions-path 2026-10-31T14:05:40.003344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:50.554078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:52.891109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:57.087948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:57.087985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:57.087999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:57.088004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T14:05:57.020Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 67 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9958ff5d-bb7b-43c9-a656-0f804bf2928a" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.132.1.135:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:59784 10.132.0.47:443 10.132.0.13:53182 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T14:05:57.511Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "8fdd471e-aaa5-49c4-9af0-8decd8d0611a" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:41708 10.132.0.47:443 10.132.0.13:53194 - v1-completions-path 2026-10-31T14:05:58.851284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:58.851320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:58.851336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:58.851341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T14:05:58.790Z] "DELETE /v1/api-keys/a634f9c3-af5e-470f-a461-dd1da049d357 HTTP/1.1" 200 - via_upstream - "-" 0 365 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "19e5140d-cfeb-4003-bb4c-81e30740c983" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.132.1.135:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:59784 10.132.0.47:443 10.132.0.13:53206 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:06:10.394941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:12.555386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:15.480345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:06:20.074Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "abeb7101-98e9-42f6-915d-51a2a84d900c" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:41708 10.132.0.47:443 10.132.0.13:40098 - v1-completions-path [2026-10-31T14:06:20.856Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "87b1880b-39d5-4ca7-a0c8-8dcd41b61c62" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:41708 10.132.0.47:443 10.132.0.13:40116 - v1-completions-path [2026-10-31T14:06:21.508Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "41959df4-234c-4dd0-a00c-6526f3720df5" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:41708 10.132.0.47:443 10.132.0.13:40130 - v1-completions-path 2026-10-31T14:06:36.494322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:46.838971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:48.839387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:52.235909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:57.251551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:13.282877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:23.566502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:25.188057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:35.400290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:38.300696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:41.557500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:49.915303Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-10-31T14:07:58.588296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:18.467045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:28.749199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:38.964603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:49.168578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:59.497876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:09.728019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:19.877523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:30.109532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:40.320077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:50.588091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:53.317411Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T14:09:53.317438Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T14:09:53.317441Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T14:09:53.317446Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T14:09:53.294Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 23 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e1ca0554-48d3-415a-b746-84088ebac117" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.13:33424 - v1-completions-path [2026-10-31T14:09:57.619Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 143 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e49b8951-8505-4dad-b132-9fc20e53d2fc" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:36942 10.132.0.47:443 10.132.0.13:33450 - v1-completions-path