2026-11-01T00:00:07.428232Z info FLAG: --concurrency="0" 2026-11-01T00:00:07.428250Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T00:00:07.428255Z info FLAG: --help="false" 2026-11-01T00:00:07.428257Z info FLAG: --log_as_json="false" 2026-11-01T00:00:07.428259Z info FLAG: --log_caller="" 2026-11-01T00:00:07.428262Z info FLAG: --log_output_level="default:info" 2026-11-01T00:00:07.428264Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T00:00:07.428275Z info FLAG: --log_target="[stdout]" 2026-11-01T00:00:07.428278Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T00:00:07.428281Z info FLAG: --outlierLogPath="" 2026-11-01T00:00:07.428283Z info FLAG: --profiling="true" 2026-11-01T00:00:07.428285Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T00:00:07.428287Z info FLAG: --proxyLogLevel="warning" 2026-11-01T00:00:07.428289Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T00:00:07.428292Z info FLAG: --stsPort="0" 2026-11-01T00:00:07.428294Z info FLAG: --templateFile="" 2026-11-01T00:00:07.428295Z info FLAG: --tokenManagerPlugin="" 2026-11-01T00:00:07.428298Z info FLAG: --vklog="0" 2026-11-01T00:00:07.428301Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T00:00:07.428449Z info Proxy role ips=[10.132.1.20] type=router id=maas-default-gateway-openshift-default-6cc458d887-bz5w9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T00:00:07.428513Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T00:00:07.430002Z info cpu limit detected as 2, setting concurrency 2026-11-01T00:00:07.430282Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T00:00:07.430293Z info JWT policy is third-party-jwt 2026-11-01T00:00:07.430296Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T00:00:07.431980Z info Starting default Istio SDS Server 2026-11-01T00:00:07.432004Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T00:00:07.432024Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T00:00:07.432744Z info Opening status port 15020 2026-11-01T00:00:07.433362Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T00:00:07.434944Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T00:00:07.435871Z info Starting proxy agent 2026-11-01T00:00:07.435903Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T00:00:07.456052Z info sds Starting SDS grpc server 2026-11-01T00:00:07.456077Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T00:00:07.522228Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T00:00:07.606668Z info cache generated new workload certificate resourceName=default latency=173.576172ms ttl=23h59m59.393339044s 2026-11-01T00:00:07.606717Z info cache Root cert has changed, start rotating root cert 2026-11-01T00:00:07.606783Z info cache returned workload trust anchor from cache ttl=23h59m59.393234273s 2026-11-01T00:00:07.766514Z info ads ADS: new connection for node:1 2026-11-01T00:00:07.774565Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T00:00:07.774620Z info cache read certificate from file resource=file-root:system 2026-11-01T00:00:07.813612Z info ads ADS: new connection for node:2 2026-11-01T00:00:07.813703Z info cache returned workload certificate from cache ttl=23h59m59.186300911s 2026-11-01T00:00:07.815038Z info ads ADS: new connection for node:3 2026-11-01T00:00:07.815114Z info cache returned workload trust anchor from cache ttl=23h59m59.184887733s 2026-11-01T00:00:07.937015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:00:15.190470Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-11-01T00:00:16.547437Z info Readiness succeeded in 9.122140612s 2026-11-01T00:00:16.547898Z info Envoy proxy is ready 2026-11-01T00:00:42.006559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:01:35.406265Z info ads ADS: new connection for node:4 2026-11-01T00:01:35.406586Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T00:01:35.406622Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T00:01:38.586147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:01:57.824315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:02:20.654612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:06:06.498915Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T00:06:08.521136Z info ads ADS: "" 1 terminated with stream closed 2026-11-01T00:13:05.245704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:14:16.099520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:17:08.981222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:19:28.730796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:27:51.753581Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T00:28:26.655203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:28:49.795271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:23.998934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:39.784192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:42.238306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:44.831963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:29:44.832000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:29:44.832015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:29:44.832020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:29:44.702Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 129 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "bca57996-8523-4d3b-93b1-2b3820e64a78" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:33642 10.132.1.20:443 10.132.0.9:34960 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:29:48.606867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:29:55.721556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:30:05.615514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:30:20.406349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:30:31.414608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:30:33.206057Z info ads ADS: new connection for node:5 2026-11-01T00:30:33.206352Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T00:30:34.533378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:31:15.937969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:31:21.395Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 349 88 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "508bb9b0-2b3c-4a4e-ac4e-ed5ea341ce7e" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.1.164:8000" outbound|54321||e2e-prio-pool-ca03fe61-inference-pool-ip-13923081.llm.svc.cluster.local 10.132.1.20:35312 10.132.1.20:443 10.132.0.9:39764 - v1-model-routing 2026-11-01T00:31:35.271567Z info ads ADS: "" 5 terminated 2026-11-01T00:31:35.316613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:31:37.706308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:31:40.525698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:31:45.615993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:33:59.053590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:33:59.053629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:33:59.053646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:33:59.053651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:33:58.970Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 83 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e603458f-831a-45dc-8f88-22123b2eefd4" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:55168 10.132.1.20:443 10.132.0.9:50668 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:34:05.289903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:21.841358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:36.185749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:34:36.185810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:34:36.185833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:34:36.185841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:34:36.105Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 80 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f93e2616-a984-4eb7-bc88-600ebae4c172" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:55168 10.132.1.20:443 10.132.0.9:54858 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:34:38.332985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:50.275417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:34:54.126009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:35:05.883508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:35:09.423139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:35:12.887436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-01T00:35:12.810Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 78 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ec450b59-1bff-4493-beac-3203cd49133e" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:52666 - v1-completions-path 2026-11-01T00:35:25.122306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:35:56.319Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 86 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ef07994c-d839-4411-b37c-44d5ea33f184" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35172 10.132.1.20:443 10.132.0.9:54100 - v1-completions-path [2026-11-01T00:36:10.936Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "48bf5eb8-41b7-45d1-a6ab-a14eee270a33" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35172 10.132.1.20:443 10.132.0.9:59474 - v1-completions-path 2026-11-01T00:36:12.264094Z info ads ADS: new connection for node:6 2026-11-01T00:36:12.267513Z info cache read certificate from file resource=file-root:system 2026-11-01T00:36:13.418895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:36:14.989867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:36:17.770318Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"605","StreamId":"9473219330701907646"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-11-01T00:36:17.755Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 15 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "72397cc2-9f96-4c95-acb3-9f519a301bee" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.1.20:443 10.132.0.9:50522 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-01T00:36:28.349304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:36:28.349337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:36:28.349348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T00:36:28.349352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:36:28.349505Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T00:36:28.235Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 114 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "465d8f4c-ebc9-4c6c-a8b2-0b7702e6a115" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.20:41160 10.132.1.20:443 10.132.0.9:54052 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:36:41.167702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:41.167733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:41.167743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:36:41.167747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:36:41.167907Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T00:36:41.060Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 107 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "2a208327-3d23-4996-9fd1-a4fcf6868b3c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.20:36036 10.132.1.20:443 10.132.0.9:44178 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:37:02.459914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:02.459942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:02.459952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:37:02.459956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:02.460108Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T00:37:02.363Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 96 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4ab34532-94ea-414f-84f7-e5d24fa33561" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.20:36036 10.132.1.20:443 10.132.0.9:45832 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:37:25.522485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:25.522514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:25.522524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:25.522528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:37:25.522700Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T00:37:25.428Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 94 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5328e3fe-f6eb-463c-8b93-247aa5f2c512" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.20:36036 10.132.1.20:443 10.132.0.9:57956 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:37:36.128542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:36.128571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:36.128581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:37:36.128585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:37:36.128737Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T00:37:36.028Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 100 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1515b996-2504-4f2d-b15f-a49c1547fc22" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.20:36036 10.132.1.20:443 10.132.0.9:60696 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T00:37:45.134846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:37:45.134876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:37:45.134890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T00:37:45.134895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T00:37:45.061Z] "DELETE /v1/api-keys/794069e8-a148-4362-af92-4525481bee0b HTTP/1.1" 200 - via_upstream - "-" 0 359 73 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "479b7a72-7f36-40d2-a0be-3f580bea5839" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:43996 10.132.1.20:443 10.132.0.9:51212 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:37:56.816670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:37:56.944341Z info ads ADS: "" 6 terminated 2026-11-01T00:37:58.319738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:38:05.078734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:38:07.906Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9264b389-9bca-472a-a77c-73d786fcfbb2" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:44726 - v1-completions-path 2026-11-01T00:38:08.657871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T00:38:08.652Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 91 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ed2c80da-f93c-4cec-9b96-6d5c8a2f9c28" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.20:443 10.132.0.9:44738 - v1-completions-path 2026-11-01T00:38:20.703708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:38:25.298565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:38:28.385Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "db7ac6c9-94ce-433c-942e-e1afde55df2b" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.20:443 10.132.0.9:56570 - v1-completions-path 2026-11-01T00:38:40.519120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:38:39.826Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 72 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "6bd453b1-33a6-4b82-a120-10f8056c59c9" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35172 10.132.1.20:443 10.132.0.9:34620 - v1-completions-path 2026-11-01T00:38:56.588952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:39:02.147Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4d45da8e-3840-4386-93f5-a8b60552a6e6" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:43518 - v1-completions-path [2026-11-01T00:39:02.834Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "aa8e56ab-927c-4189-8910-4c58bf41f202" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:43520 - v1-completions-path [2026-11-01T00:39:03.935Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 56 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "48140a7c-05fa-41ec-9f2a-21d9be60993b" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:43524 - v1-completions-path [2026-11-01T00:39:04.591Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5a29cf16-e413-47cc-8b6b-b861af3dfd89" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:39694 10.132.1.20:443 10.132.0.9:43528 - v1-completions-path 2026-11-01T00:39:20.047699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:30.310188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:34.887511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:38.426222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:38.426257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:38.426271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:38.426277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T00:39:38.344Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 82 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "02d2f563-f61c-4381-83a3-08fbb33de1d1" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:59198 10.132.1.20:443 10.132.0.9:60302 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T00:39:38.887Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 66 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "d2820117-fcd9-4af9-ae8e-f070954a9aab" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:39694 10.132.1.20:443 10.132.0.9:60312 - v1-completions-path 2026-11-01T00:39:51.843824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:54.180666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:39:55.001767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:55.001819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:55.001834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:39:55.001839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T00:39:54.900Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 101 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "41e03b3c-ca7c-42f1-9961-cea6c9bf46c8" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:59198 10.132.1.20:443 10.132.0.9:41226 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T00:39:55.022Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 303 1946 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "83e51cd7-60fd-4297-9aee-3f8340144576" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.47:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:56414 10.132.1.20:443 10.132.0.9:41228 - v1-completions-path 2026-11-01T00:40:01.269174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:13.187980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:18.404496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:26.730183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:32.000816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:50.288858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:40:53.245331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:41:10.086Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 65 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f9b0be27-2db1-4004-b67a-b9de7fe171bd" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:60416 10.132.1.20:443 10.132.0.9:45760 - v1-completions-path 2026-11-01T00:41:17.141239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:41:22.653136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:41:22.653172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:41:22.653188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T00:41:22.653193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T00:41:22.579Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 73 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "26f1db0a-dc21-40e1-aa55-2339b0f73cd0" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:55372 10.132.1.20:443 10.132.0.9:50728 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:41:35.113068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:41:45.368561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:43:45.774587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:43:45.774628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:43:45.774645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:43:45.774650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T00:43:45.693Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 80 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "be1491fd-d065-4bbd-839a-667592876357" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:33388 10.132.1.20:443 10.132.0.9:36954 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:45:26.182920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:45:41.590249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:45:43.863076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:45:50.983130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:10.802039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:14.402120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:46:17.308Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 77 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "4add30cf-cfa8-4684-ac6f-66f3858e6f8a" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:57398 - v1-completions-path [2026-11-01T00:46:17.853Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "646777ec-4b06-4a64-954a-bb2669b4a595" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:57410 - v1-completions-path 2026-11-01T00:46:18.478462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:46:18.478497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T00:46:18.478513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T00:46:18.478518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T00:46:18.404Z] "DELETE /v1/api-keys/768d6c72-d75d-475e-9f50-ba0d2e304662 HTTP/1.1" 200 - via_upstream - "-" 0 369 74 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "b4095235-c118-4c16-974c-92d3ef6bc28d" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.133.0.180:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:59518 10.132.1.20:443 10.132.0.9:57428 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:46:29.992999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:40.366629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:46:45.440434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:46:49.648Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1efcb0f4-2b7c-4a14-8ae8-4970f91990de" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:40582 - v1-completions-path [2026-11-01T00:46:49.828Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e60de56c-85bc-414e-8858-9ee66d9364fe" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:40588 - v1-completions-path [2026-11-01T00:46:50.278Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "a80bbe7a-e46f-42c4-92bb-37e59dbe8748" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:40602 - v1-completions-path 2026-11-01T00:47:02.485587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:06.934538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:10.454824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:47:17.494Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "5f5d7b1e-5382-483b-ac0b-7259ecdb9f61" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:58162 - v1-completions-path [2026-11-01T00:47:17.862Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "1d150415-c362-4f17-ae7f-d334d3bf9945" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:58178 - v1-completions-path [2026-11-01T00:47:18.220Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "32c22ea2-4cc6-499b-809d-77973aaf30ee" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:58192 - v1-completions-path [2026-11-01T00:47:18.579Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "678ff40e-dc7f-436e-8eb3-9870e61c3953" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:35180 10.132.1.20:443 10.132.0.9:58202 - v1-completions-path [2026-11-01T00:47:18.950Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9c928f69-700c-441b-9860-c839e2502977" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:39694 10.132.1.20:443 10.132.0.9:58216 - v1-completions-path [2026-11-01T00:47:19.897Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "d6a91753-faa5-453f-9502-82375a9947c0" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:39694 10.132.1.20:443 10.132.0.9:58238 - v1-completions-path 2026-11-01T00:47:33.135765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:43.470578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:47.920062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:51.362461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:47:54.310906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:47:54.310958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T00:47:54.310980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T00:47:54.310988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T00:47:54.176Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 134 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "dca9abd9-59eb-4fd7-ba69-3a096261ceda" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.132.1.112:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.20:41278 10.132.1.20:443 10.132.0.9:37302 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T00:47:56.280623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T00:48:02.116Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "aabb7e81-bd97-4564-94bc-acb69c921e81" "maas.apps.84f85b540f82405c5762.prod.konflux-ocp-ci.dev" "10.134.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.20:39694 10.132.1.20:443 10.132.0.9:41232 - v1-completions-path 2026-11-01T00:48:14.793485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:23.895172Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-01T00:48:25.105502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:27.322219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:36.940303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:40.507059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:48:58.356994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:00.593006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:19.062135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:29.489235Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:40.004499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:49:50.281260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:00.669091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:10.995931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:21.401560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:31.745916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:42.034840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T00:50:52.360456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8