2026-10-31T12:51:32.695727Z info FLAG: --concurrency="0" 2026-10-31T12:51:32.695744Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T12:51:32.695748Z info FLAG: --help="false" 2026-10-31T12:51:32.695750Z info FLAG: --log_as_json="false" 2026-10-31T12:51:32.695752Z info FLAG: --log_caller="" 2026-10-31T12:51:32.695754Z info FLAG: --log_output_level="default:info" 2026-10-31T12:51:32.695756Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T12:51:32.695761Z info FLAG: --log_target="[stdout]" 2026-10-31T12:51:32.695763Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T12:51:32.695765Z info FLAG: --outlierLogPath="" 2026-10-31T12:51:32.695767Z info FLAG: --profiling="true" 2026-10-31T12:51:32.695769Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T12:51:32.695771Z info FLAG: --proxyLogLevel="warning" 2026-10-31T12:51:32.695773Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T12:51:32.695775Z info FLAG: --stsPort="0" 2026-10-31T12:51:32.695777Z info FLAG: --templateFile="" 2026-10-31T12:51:32.695779Z info FLAG: --tokenManagerPlugin="" 2026-10-31T12:51:32.695782Z info FLAG: --vklog="0" 2026-10-31T12:51:32.695784Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T12:51:32.695952Z info Proxy role ips=[10.133.0.49] type=router id=maas-default-gateway-openshift-default-fc8c56547-fv482.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T12:51:32.696021Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T12:51:32.697122Z info cpu limit detected as 2, setting concurrency 2026-10-31T12:51:32.697318Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T12:51:32.697330Z info JWT policy is third-party-jwt 2026-10-31T12:51:32.697332Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T12:51:32.699567Z info Starting default Istio SDS Server 2026-10-31T12:51:32.699595Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T12:51:32.699620Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T12:51:32.699961Z info Opening status port 15020 2026-10-31T12:51:32.700837Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T12:51:32.701744Z info sds Starting SDS grpc server 2026-10-31T12:51:32.701760Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T12:51:32.702145Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T12:51:32.702978Z info Starting proxy agent 2026-10-31T12:51:32.703008Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T12:51:32.740360Z info cache generated new workload certificate resourceName=default latency=38.517904ms ttl=23h59m59.259642678s 2026-10-31T12:51:32.740398Z info cache Root cert has changed, start rotating root cert 2026-10-31T12:51:32.740431Z info cache returned workload trust anchor from cache ttl=23h59m59.259569984s 2026-10-31T12:51:32.786061Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T12:51:32.889054Z info ads ADS: new connection for node:1 2026-10-31T12:51:32.889126Z info cache returned workload certificate from cache ttl=23h59m59.110875454s 2026-10-31T12:51:32.889208Z info ads ADS: new connection for node:2 2026-10-31T12:51:32.889289Z info cache returned workload trust anchor from cache ttl=23h59m59.110712421s 2026-10-31T12:51:32.989411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:51:40.919066Z info Readiness succeeded in 8.22656234s 2026-10-31T12:51:40.919816Z info Envoy proxy is ready 2026-10-31T12:54:12.642700Z info ads ADS: new connection for node:3 2026-10-31T12:54:12.647786Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T12:54:12.647903Z info cache read certificate from file resource=file-root:system 2026-10-31T12:54:13.139585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:19.996228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:28.898864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:43.698952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:54:54.898158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:54.898188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:54.898204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:54:54.898208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T12:54:54.898353Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T12:54:54.750Z] "POST /anything/e2e-rt-sw-570c25-client HTTP/1.1" 200 - via_upstream - "-" 124 1751 147 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "cb6ee67b-c074-4e7e-99d7-e09cccdaddc5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.49:33642 10.133.0.49:443 10.132.0.13:39842 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.0 2026-10-31T12:55:00.084661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:00.084697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:00.084707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:55:00.084711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:00.084909Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T12:54:59.958Z] "POST /anything/e2e-rt-sw-570c25-client HTTP/1.1" 200 - via_upstream - "-" 124 1758 125 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "40ef5863-9856-46db-9416-04dbbfb94948" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.49:33658 10.133.0.49:443 10.132.0.13:39866 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.0 2026-10-31T12:55:01.417449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:01.417485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:01.417501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:01.417505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:55:01.417693Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T12:55:01.355Z] "POST /llm/e2e-rt-sw-570c25/anything/e2e-rt-sw-570c25-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1c555c61-28e0-4451-b029-fb895dcbbaf4" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-570c25.llm.svc.cluster.local - 10.133.0.49:443 10.132.0.13:39888 - llm.external-model-e2e-rt-sw-570c25-ecedc58a0f6b.2 2026-10-31T12:55:13.711879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:40.797724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:53.872889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:55:57.486703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:57.486759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:57.486782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:57.486789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:55:57.737868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:57.737904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:57.737919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:55:57.737925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:55:57.738133Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T12:55:55.048Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 2438 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "f906c17e-e08b-4170-a195-28cbaac24ae6" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:43694 10.133.0.49:443 10.132.0.13:33434 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:55:57.561Z] "POST /anything/e2e-rt-eq-43bdd0-client HTTP/1.1" 200 - via_upstream - "-" 124 1760 176 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "2399fdf1-7ce3-4374-b2f6-a7b5e77cb91f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.49:55816 10.133.0.49:443 10.132.0.13:33452 - llm.external-model-e2e-rt-eq-43bdd0-dc669f641903.0 2026-10-31T12:56:22.238006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:23.236381Z info ads ADS: "" 3 terminated with stream closed 2026-10-31T12:56:23.742337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:56:38.885191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:57:45.216578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:59:23.659379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T12:59:39.739385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T12:59:39.808130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:39.808166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:39.808182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:39.808187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:59:39.731Z] "DELETE /v1/api-keys/497ede5a-f79c-4f7b-bfde-6fc4aff44825 HTTP/1.1" 200 - via_upstream - "-" 0 370 76 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "0ba2ee6e-1f95-46f4-bae9-bc7e473f75f6" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:48020 10.133.0.49:443 10.132.0.13:53602 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:41.084853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:41.084897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:41.084918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:41.084924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:59:41.022Z] "DELETE /v1/api-keys/ccb80049-0545-4aac-9902-bf34c77f96a7 HTTP/1.1" 200 - via_upstream - "-" 0 321 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "90e7b16b-7789-46c5-b293-b1be70f24a43" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:48020 10.133.0.49:443 10.132.0.13:53628 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:41.938977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:41.939019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:41.939034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:41.939039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:42.333237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:42.333274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T12:59:42.333290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T12:59:42.333296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T12:59:41.878Z] "DELETE /v1/api-keys/80aa2f6b-c290-4912-a256-14857cbdaca3 HTTP/1.1" 200 - via_upstream - "-" 0 321 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "906151a7-afa6-4981-9630-dc717de69a62" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:48020 10.133.0.49:443 10.132.0.13:53632 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:59:42.254Z] "DELETE /v1/api-keys/d97304da-69d6-4fb6-97b2-f5b6a6ad3f12 HTTP/1.1" 200 - via_upstream - "-" 0 321 79 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "22b720b1-3fa2-4322-a226-6f9cbc8a965a" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:48020 10.133.0.49:443 10.132.0.13:53644 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T12:59:43.961038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:59:43.961088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:59:43.961108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T12:59:43.961116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T12:59:43.788Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 172 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "451ffb5d-0086-42c2-9a1b-73862a00ffde" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:48036 10.133.0.49:443 10.132.0.13:60282 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T12:59:59.153Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 83 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "2222c0a6-9182-43b0-adc5-d12e4486be66" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:47160 10.133.0.49:443 10.132.0.13:46096 - v1-completions-path 2026-10-31T13:00:02.091122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:00:02.091161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:00:02.091179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:00:02.091184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T13:00:02.029Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 61 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "13001b5f-8bcd-435b-a9f5-ff47dd9c2efd" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:48020 10.133.0.49:443 10.132.0.13:46120 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:00:08.114555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:00:28.466397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:04:37.444212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:04:37.444250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:04:37.444269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:04:37.444274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T13:04:37.381Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1c3a66f9-4de3-41b2-8314-bc8f71a52f1e" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:52962 10.133.0.49:443 10.132.0.13:57304 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:04:37.635Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 324 64 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "34cf303e-6049-481a-ac0f-0edcf12a5e76" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:37486 10.133.0.49:443 10.132.0.13:57310 - v1-chat-completions-path 2026-10-31T13:04:52.360586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T13:04:52.297Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 322 64 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "50a5d4da-34cf-4aff-8a8f-8702e5d99a01" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:37486 10.133.0.49:443 10.132.0.13:32946 - v1-chat-completions-path 2026-10-31T13:13:42.935419Z info ads ADS: new connection for node:4 2026-10-31T13:13:42.941017Z info cache read certificate from file resource=file-root:system 2026-10-31T13:20:20.956737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:20:44.441753Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T13:21:02.609403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:22:05.711103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:22:24.782727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:03.860944Z info ads ADS: new connection for node:5 2026-10-31T13:23:03.861122Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:23:03.861153Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:23:22.396421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:27.692855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:23:27.692897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:23:27.692918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:23:27.692925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T13:23:27.619Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 72 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "308dc4a0-01b6-4ad1-b786-48b430bd0c29" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:49012 10.133.0.49:443 10.132.0.13:56244 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:23:28.116542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:28.116584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:28.116600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:23:28.116606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:23:28.116837Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T13:23:27.979Z] "POST /anything/e2e-dft-07ef48-464c90 HTTP/1.1" 200 - via_upstream - "-" 109 1751 137 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "a419374a-bf03-4ffe-b765-ce167cfb8ce2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.49:45760 10.133.0.49:443 10.132.0.13:56252 - llm.external-model-e2e-dft-07ef48-b77f9f31caae.0 2026-10-31T13:23:40.215520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:24:05.606322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:26:41.759563Z info ads ADS: "" 5 terminated 2026-10-31T13:30:09.494173Z info ads ADS: "" 4 terminated with stream closed 2026-10-31T13:33:38.994027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:35:25.071889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:36:51.200514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:37:32.823097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:38:49.217906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:40:34.505002Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-31T13:42:31.470584Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T13:48:00.826100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:01.362487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:48:01.362523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:48:01.362538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:48:01.362543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T13:48:01.290Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 71 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "76db4583-3e7e-49dd-9f46-b33cf1e3b01e" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:51714 10.133.0.49:443 10.132.0.13:43066 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:48:24.742106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:48:57.361083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:49:01.250Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "71fa8514-deeb-4154-a124-6a1526f43671" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:57054 10.133.0.49:443 10.132.0.13:41520 - v1-chat-completions-path 2026-10-31T13:49:01.793021Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-10-31T13:49:12.845470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:14.755005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:17.484009Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-31T13:49:17.406Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 77 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "f8c9cb16-90a8-45d2-b957-560100f5f9cf" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:51756 10.133.0.49:443 10.132.0.13:53984 - v1-catch-all-path 2026-10-31T13:49:18.179193Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T13:49:18.116Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 63 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "a062b19b-9abb-40f9-8829-cf8866054fc7" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:51768 10.133.0.49:443 10.132.0.13:53998 - v1-catch-all-model-routing 2026-10-31T13:49:20.853426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:23.640018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:49:23.640056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:49:23.640070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:49:23.640074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T13:49:23.573Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 66 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "05160b1f-666c-4375-91e4-ef8c4c5aa14b" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:42836 10.133.0.49:443 10.132.0.13:60426 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:49:35.951312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:37.708415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:49:43.551132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:02.834297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:04.519736Z info ads ADS: new connection for node:6 2026-10-31T13:50:04.520046Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:50:04.520130Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T13:50:06.124740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:50:46.868481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:50:52.306Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 341 89 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "54bb6a97-f524-4f1b-a619-b3fa8d18773e" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.1.1:8000" outbound|54321||e2e-prio-pool-7217b54d-inference-pool-ip-717abdc3.llm.svc.cluster.local 10.133.0.49:39556 10.133.0.49:443 10.132.0.13:54388 - v1-model-routing 2026-10-31T13:51:05.824182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:05.947777Z info ads ADS: "" 6 terminated with stream closed 2026-10-31T13:51:07.731241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:10.096551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:51:14.268854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:53:27.090201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:53:46.100529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:00.268110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:11.958131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:15.522785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:26.677108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:29.041066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:44.207487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:54:59.295Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 67 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e10c2262-f454-4cc7-9171-e31ae8fb7542" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:47160 10.133.0.49:443 10.132.0.13:46262 - v1-completions-path [2026-10-31T13:55:00.046Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "0b614605-a35d-4a88-8209-96547f9d57ee" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:37486 10.133.0.49:443 10.132.0.13:46266 - v1-completions-path 2026-10-31T13:55:29.249883Z info ads ADS: new connection for node:7 2026-10-31T13:55:29.258310Z info cache read certificate from file resource=file-root:system 2026-10-31T13:55:29.857039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:55:31.447477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:55:38.803217Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"1036","StreamId":"1847396396272341537"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-10-31T13:55:38.731Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 72 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9e44c567-241b-4c04-af97-bd3acb39b516" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.49:443 10.132.0.13:35222 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-31T13:55:40.919692Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"1039","StreamId":"2591271975365086270"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-10-31T13:55:40.863Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 56 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "207e6e47-a8ae-41d0-b6d7-3a2197fac349" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.49:443 10.132.0.13:35224 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-31T13:57:07.900744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:08.051051Z info ads ADS: "" 7 terminated 2026-10-31T13:57:08.501097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:11.157514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:13.387330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:57:16.695Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 152 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "617a0f5a-60d5-4e6b-8046-e9ca6923ec97" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:50056 10.133.0.49:443 10.132.0.13:42016 - v1-completions-path 2026-10-31T13:57:28.770567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:30.426700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:44.990271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:46.754238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:49.479404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:57:57.841242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:58:03.957Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "a25aef45-5044-467f-b703-db9de98e62ee" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:42990 10.133.0.49:443 10.132.0.13:48390 - v1-completions-path [2026-10-31T13:58:04.516Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "3054d247-df7f-4ef7-bf9f-e32efb5d31ad" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:42990 10.133.0.49:443 10.132.0.13:48398 - v1-completions-path [2026-10-31T13:58:04.970Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 53 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "51b6792e-0b05-476f-98bd-a187f05dc68b" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.49:443 10.132.0.13:48406 - v1-completions-path [2026-10-31T13:58:05.186Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7e2c56e2-1ba4-4781-9d2c-ce1de41da255" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:42990 10.133.0.49:443 10.132.0.13:48420 - v1-completions-path 2026-10-31T13:58:22.233265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:32.542402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:36.399315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:58:40.289Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "2c6eaa66-fcc9-9bc3-bbdc-903ff52f954b" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:50056 10.133.0.49:443 10.132.0.13:53524 - v1-completions-path 2026-10-31T13:58:52.443184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:54.127257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:58:59.617067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:10.479792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:24.224939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:25.929960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:31.331130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:49.544450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:52.049614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:59:54.556472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:59:54.556521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:59:54.556542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:59:54.556548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T13:59:52.823Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 1733 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5971720e-59d9-4c92-8d09-ab92ba84d7e3" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:36008 10.133.0.49:443 10.132.0.13:41818 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:00:07.204986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:09.366464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:09.855337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:09.855370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:09.855382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T14:00:09.855387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T14:00:09.798Z] "DELETE /v1/api-keys/92cf2496-870c-4bef-ae89-dec2db194680 HTTP/1.1" 404 - via_upstream - "-" 0 29 56 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "faccad86-b6fa-4bc3-970c-9377b0a3aeb6" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:36008 10.133.0.49:443 10.132.0.13:33884 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T14:00:11.339Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 32 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "02ab5ca2-19bf-43af-9406-b28129e2847f" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.49:443 10.132.0.13:33886 - v1-completions-path 2026-10-31T14:00:14.146782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:00:17.259Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 61 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1e76096b-ed16-44e7-a8be-9c8ae28a8138" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:42990 10.133.0.49:443 10.132.0.13:51036 - v1-completions-path 2026-10-31T14:00:28.969557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:39.226204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:54.975903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:00:57.277372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:03:11.356Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 45 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c688d60d-5b01-4c34-9209-51095ee78951" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.49:443 10.132.0.13:55882 - v1-completions-path 2026-10-31T14:03:12.423684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:03:14.725196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:39.550050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:54.613031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:56.274202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:04:59.049Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 71 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "98cba8ed-7360-4951-8ad4-9cbd5cfd0d8c" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:47160 10.133.0.49:443 10.132.0.13:49818 - v1-completions-path 2026-10-31T14:05:02.038427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:20.661272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:24.538677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:40.038784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:50.559927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:52.865985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:05:57.732Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 66 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e8b52472-0443-4cb8-b539-02ea3828b154" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:42990 10.133.0.49:443 10.132.0.13:44928 - v1-completions-path [2026-10-31T14:05:57.957Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e3d3f6a7-f6f0-46f4-a27d-0df305029e48" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:42990 10.133.0.49:443 10.132.0.13:44932 - v1-completions-path 2026-10-31T14:06:10.378500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:12.534358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:15.478600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:06:21.727Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 71 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "b2fbbe0a-759c-4660-b497-0ac9a8dff7f4" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:50056 10.133.0.49:443 10.132.0.13:39428 - v1-completions-path 2026-10-31T14:06:36.491874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:46.825053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:48.839133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:52.235283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:57.231572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:01.853608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:07:01.853666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:07:01.853683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:07:01.853688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T14:07:01.434Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e745293a-28c8-453f-b3d9-cc928c97a574" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.49:50056 10.133.0.49:443 10.132.0.13:60710 - v1-completions-path [2026-10-31T14:07:01.662Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "b27dbf76-f554-47bd-9882-b7a092d1af8a" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.49:443 10.132.0.13:60718 - v1-completions-path [2026-10-31T14:07:01.794Z] "DELETE /v1/api-keys/c2eddd0e-6e04-4765-8bc8-f44bcfedb133 HTTP/1.1" 200 - via_upstream - "-" 0 367 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "0c020ad0-77b5-40d3-b9ce-dd19e9875124" "maas.apps.756adc0f43ff2ca145eb.prod.konflux-ocp-ci.dev" "10.132.1.135:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.49:39262 10.133.0.49:443 10.132.0.13:60720 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:07:13.284420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:23.553816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:25.176346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:35.423142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:38.286077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:41.566995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:58.596355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:18.459348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:28.734837Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:38.963185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:49.159580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:59.517288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:09.747118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:19.913983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:30.112250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:40.349792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:50.586418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8