2026-11-02T21:20:10.120232Z info FLAG: --concurrency="0" 2026-11-02T21:20:10.120252Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T21:20:10.120256Z info FLAG: --help="false" 2026-11-02T21:20:10.120258Z info FLAG: --log_as_json="false" 2026-11-02T21:20:10.120260Z info FLAG: --log_caller="" 2026-11-02T21:20:10.120262Z info FLAG: --log_output_level="default:info" 2026-11-02T21:20:10.120265Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T21:20:10.120269Z info FLAG: --log_target="[stdout]" 2026-11-02T21:20:10.120272Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T21:20:10.120274Z info FLAG: --outlierLogPath="" 2026-11-02T21:20:10.120276Z info FLAG: --profiling="true" 2026-11-02T21:20:10.120294Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T21:20:10.120296Z info FLAG: --proxyLogLevel="warning" 2026-11-02T21:20:10.120299Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T21:20:10.120301Z info FLAG: --stsPort="0" 2026-11-02T21:20:10.120303Z info FLAG: --templateFile="" 2026-11-02T21:20:10.120305Z info FLAG: --tokenManagerPlugin="" 2026-11-02T21:20:10.120308Z info FLAG: --vklog="0" 2026-11-02T21:20:10.120310Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T21:20:10.120471Z info Proxy role ips=[10.132.1.102] type=router id=maas-default-gateway-openshift-default-5db77fbd9f-2sf82.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T21:20:10.120520Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T21:20:10.121732Z info cpu limit detected as 2, setting concurrency 2026-11-02T21:20:10.121938Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T21:20:10.121949Z info JWT policy is third-party-jwt 2026-11-02T21:20:10.121952Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T21:20:10.123700Z info Starting default Istio SDS Server 2026-11-02T21:20:10.123730Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T21:20:10.123753Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T21:20:10.124126Z info Opening status port 15020 2026-11-02T21:20:10.124889Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T21:20:10.125872Z info sds Starting SDS grpc server 2026-11-02T21:20:10.125962Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T21:20:10.126558Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T21:20:10.127358Z info Starting proxy agent 2026-11-02T21:20:10.127389Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T21:20:10.191843Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T21:20:10.272220Z info cache generated new workload certificate resourceName=default latency=146.181308ms ttl=23h59m59.727784937s 2026-11-02T21:20:10.272261Z info cache Root cert has changed, start rotating root cert 2026-11-02T21:20:10.272315Z info cache returned workload trust anchor from cache ttl=23h59m59.727686324s 2026-11-02T21:20:10.343046Z info ads ADS: new connection for node:1 2026-11-02T21:20:10.343061Z info ads ADS: new connection for node:2 2026-11-02T21:20:10.343124Z info cache returned workload certificate from cache ttl=23h59m59.656879005s 2026-11-02T21:20:10.343126Z info cache returned workload trust anchor from cache ttl=23h59m59.656874976s 2026-11-02T21:20:10.426106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:20:18.564044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:20:19.525441Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T21:20:19.625410Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T21:20:20.636335Z info Readiness succeeded in 10.518784819s 2026-11-02T21:20:20.636641Z info Envoy proxy is ready 2026-11-02T21:20:52.694161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:20:55.467Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 147 412 102 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "8d3481f0-0143-4401-8ad2-983392afd72c" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:36872 10.132.1.102:443 10.132.0.22:55902 - v1-chat-completions-path [2026-11-02T21:20:55.875Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 2817 3089 67 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "3bc75f5a-5ecc-4974-bdb3-fe5d75a8861e" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:36872 10.132.1.102:443 10.132.0.22:55904 - v1-chat-completions-path [2026-11-02T21:20:56.153Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 341 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "257eda4e-589a-4916-a566-50e04640f5e7" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:48826 10.132.1.102:443 10.132.0.22:55918 - v1-chat-completions-path [2026-11-02T21:20:57.122Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 282 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "87b5ad55-a408-4571-a31b-18688f0dd97a" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.39:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:48826 10.132.1.102:443 10.132.0.22:48556 - v1-chat-completions-path 2026-11-02T21:21:11.632111Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:21:16.196190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:21:18.244369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:21:18.244410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:21:18.244429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:21:18.244436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:21:19.078493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T21:21:19.079566Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T21:21:18.083Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 161 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "8ce51fed-b7b9-4a42-96d7-3290ac17a795" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:60138 10.132.1.102:443 10.132.0.22:58384 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:21:19.347766Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T21:21:18.984Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 94 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2b015b71-9d06-4aea-95a4-7f0832367a1e" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:60404 10.132.1.102:443 10.132.0.22:58388 - v1-catch-all-path [2026-11-02T21:21:19.282Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d843c11d-840e-4618-a240-e91acb46ee43" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:60404 10.132.1.102:443 10.132.0.22:58394 - v1-catch-all-model-routing 2026-11-02T21:21:25.099520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:21:27.273593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:21:27.273631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:21:27.273645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T21:21:27.273650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T21:21:27.158Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 114 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "092b8294-ce0d-4854-b098-a795576fa0ab" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:47638 10.132.1.102:443 10.132.0.22:39902 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:21:29.507321Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T21:21:29.430Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 77 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "bdf91b58-17c4-44a9-ba0d-48e28c392f81" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:60404 10.132.1.102:443 10.132.0.22:39916 - v1-catch-all-path 2026-11-02T21:21:30.226709Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T21:21:30.163Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "1f5a4c88-c0a6-448c-8a4a-84c8c1e47f28" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:60404 10.132.1.102:443 10.132.0.22:39922 - v1-catch-all-path [2026-11-02T21:21:30.511Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "85dd5554-8b68-46c5-ba30-878f9e53c921" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.102:443 10.132.0.22:39940 - v1-catch-all-path 2026-11-02T21:21:37.756109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:21:46.310396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:22:03.101902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:22:15.268406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:22:17.782925Z info ads ADS: new connection for node:3 2026-11-02T21:22:17.783106Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T21:22:17.783176Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T21:22:22.301522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:05.651228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:08.554040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:23:08.554087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:23:08.554101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T21:23:08.554106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T21:23:08.372Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 181 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "efc5d747-c061-4901-98f3-1f8146e3fa0a" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:35958 10.132.1.102:443 10.132.0.22:58312 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:23:11.316301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T21:23:11.258Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 346 90 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "cf0a4117-e1e1-4f2b-8cc0-9dc0396de555" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.212:8000" outbound|54321||e2e-prio-pool-006730b5-inference-pool-ip-8d0ecc4a.llm.svc.cluster.local 10.132.1.102:59940 10.132.1.102:443 10.132.0.22:58328 - v1-model-routing [2026-11-02T21:23:15.299Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 343 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ca2ba315-be86-44ac-bca6-b7ccd24ceb82" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.212:8000" outbound|54321||e2e-prio-pool-006730b5-inference-pool-ip-8d0ecc4a.llm.svc.cluster.local 10.132.1.102:59940 10.132.1.102:443 10.132.0.22:58336 - v1-model-routing 2026-11-02T21:23:29.273714Z info ads ADS: "" 3 terminated 2026-11-02T21:23:29.580626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:34.182004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:49.994808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:26:23.334624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:26:50.508677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:21.523917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:36.683885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:42.880411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:54.363564Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:57.334950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:28:00.019438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:28:00.019488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:28:00.019513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:28:00.019521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T21:27:59.853Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 165 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "5e241e6b-abd0-49cc-974e-a90d6f9e9dcb" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:43388 10.132.1.102:443 10.132.0.22:45620 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:28:15.344806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:28:46.030Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 80 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ad6fd846-34ab-40a4-95f7-bdc79d5f4b9b" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:52566 10.132.1.102:443 10.132.0.22:36932 - v1-completions-path 2026-11-02T21:29:03.092197Z info ads ADS: new connection for node:4 2026-11-02T21:29:03.095857Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T21:29:03.095897Z info cache read certificate from file resource=file-root:system 2026-11-02T21:29:06.684471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:29:08.021433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:29:46.285523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:46.285558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:46.285573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:29:46.285577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T21:29:46.285738Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T21:29:46.086Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 199 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9f315e7e-b860-4d29-ace0-4e67a70fed14" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.102:42996 10.132.1.102:443 10.132.0.22:45124 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:30:02.837219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:30:02.837254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:30:02.837264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T21:30:02.837269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:30:02.837454Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T21:30:02.700Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 136 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "0adf40fd-d627-4950-b66d-e61f8fe9e6d7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.102:42996 10.132.1.102:443 10.132.0.22:49792 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:30:21.686483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:30:21.686519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:30:21.686532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:30:21.686537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:30:21.686710Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T21:30:21.483Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 203 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6a8b23cd-d7f8-4aa3-a5bf-3a234e3d7d0e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.102:58868 10.132.1.102:443 10.132.0.22:53552 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:30:36.669855Z info ads ADS: "" 4 terminated 2026-11-02T21:30:36.712780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:30:37.004544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:30:37.004584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:30:37.004600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T21:30:37.004605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T21:30:36.884Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 120 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c9c1eaf8-b877-464b-9f4f-34721129a7c7" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:53424 10.132.1.102:443 10.132.0.22:55170 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:30:39.274236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:30:49.484451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:30:54.131Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d72a1eb3-9b55-45da-a838-298a034d7cc3" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.102:443 10.132.0.22:32832 - v1-completions-path 2026-11-02T21:31:07.746706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:12.193665Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:32.234494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:50.708137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:31:56.588Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 81 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2e3ad4e5-388c-4d9e-827d-6dea936e225c" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:59806 - v1-completions-path [2026-11-02T21:31:59.501Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "7be9e033-e0e0-4451-afcf-02d6e1a7da05" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:59818 - v1-completions-path 2026-11-02T21:32:19.196648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:32:29.810883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:32:36.039727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:32:46.727958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:32:46.727998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:32:46.728015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:32:46.728020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T21:32:46.606Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 121 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "40bfde54-862a-4913-be45-51b99cd9b7a7" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:47834 10.132.1.102:443 10.132.0.22:42976 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T21:32:48.523Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c08b3f0e-8aad-456f-b93f-769cb2c09653" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:42986 - v1-completions-path [2026-11-02T21:32:49.320Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "1e16b762-4a27-48e1-be0b-81a6971c2dba" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:42600 10.132.1.102:443 10.132.0.22:43002 - v1-completions-path [2026-11-02T21:32:49.828Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 56 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e01c5c8c-d083-416c-bb50-b31163502fee" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:43018 - v1-completions-path 2026-11-02T21:33:04.424676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:08.702523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:21.521771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:33:24.183Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 66 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "65faa8ad-ddca-4c75-bf8e-77aaeebafacb" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:52566 10.132.1.102:443 10.132.0.22:48556 - v1-completions-path 2026-11-02T21:33:30.248671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:39.398388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:33:41.380Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 71 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "72cce874-2110-450e-a089-16df5a2d6cf4" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:58192 10.132.1.102:443 10.132.0.22:55654 - v1-completions-path 2026-11-02T21:33:45.395632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:59.302275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:33:59.011Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 79 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "0f61bcdd-2f56-4ca1-bbe6-8fbaa9c5386b" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:52566 10.132.1.102:443 10.132.0.22:45388 - v1-completions-path 2026-11-02T21:34:14.334565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:20.041102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:34:22.606Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 74 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2bc55936-0418-4fce-8ceb-93a8e71cfcc9" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:52566 10.132.1.102:443 10.132.0.22:52312 - v1-completions-path 2026-11-02T21:34:37.996897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:43.238426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:45.820232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:34:45.820298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:34:45.820323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:34:45.820331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T21:34:45.704Z] "DELETE /v1/api-keys/a5292dbf-4407-4e84-84a8-ecdb553c3338 HTTP/1.1" 200 - via_upstream - "-" 0 375 115 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "f972aced-f4c7-48cc-a88d-4ef07c2fa353" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:35580 10.132.1.102:443 10.132.0.22:32910 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:34:54.056463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:03.902600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:35:03.902642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:35:03.902659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:35:03.902664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T21:35:03.786Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 115 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "5ce263c2-0be9-445f-919d-dbe1657b406e" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:52372 10.132.1.102:443 10.132.0.22:38194 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:35:18.034541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:28.770861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:33.800391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:35:33.800429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:35:33.800445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:35:33.800451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T21:35:33.685Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 114 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "1c10dbcd-2948-4f2d-8f7d-d994f033bf39" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:52372 10.132.1.102:443 10.132.0.22:44142 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:35:49.088014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:56.543721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:38:06.782228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:38:06.782269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:38:06.782306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:38:06.782313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T21:38:06.657Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 125 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "1537b38b-b15f-4a83-9a6c-15de24c014d6" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:33888 10.132.1.102:443 10.132.0.22:38796 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:38:22.193410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:39:51.784870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:08.991303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:13.777480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:16.600926Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T21:40:16.600953Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T21:40:16.600956Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T21:40:16.600959Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T21:40:16.555Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 45 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "80e99e5b-6260-4d9d-a14a-c68c7b44a37b" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.102:443 10.132.0.22:49742 - v1-completions-path 2026-11-02T21:40:26.442471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:42.622651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:48.993003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:08.588322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:19.282170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:25.435023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:52.641149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:58.826658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:04.579052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:11.283903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:42:11.283939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:42:11.283954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:42:11.283960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T21:42:11.163Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 120 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ad521159-3fca-468e-a720-e35de4d57256" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.227:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:47496 10.132.1.102:443 10.132.0.22:60216 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T21:42:16.174Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 68 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "90e594a5-4d17-4829-82c7-07786061eb43" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:60234 - v1-completions-path [2026-11-02T21:42:16.897Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "069d2c17-fc39-4955-89be-773fbbf8673a" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:52588 - v1-completions-path [2026-11-02T21:42:18.721Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "8d434c92-cbf4-4aa3-a4b2-d042b60551f7" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:42600 10.132.1.102:443 10.132.0.22:52608 - v1-completions-path [2026-11-02T21:42:19.805Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ffd00178-bf14-4e81-b920-8ebdeac991ed" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:52622 - v1-completions-path [2026-11-02T21:42:20.539Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b6d33c5d-3d57-42c0-9a59-41625d5115cd" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:52626 - v1-completions-path 2026-11-02T21:42:21.252020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:42:21.252059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:42:21.252073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T21:42:21.252079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T21:42:21.136Z] "DELETE /v1/api-keys/2936c200-d423-4fba-b218-62534a67d305 HTTP/1.1" 200 - via_upstream - "-" 0 363 115 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "83637524-cbe2-483f-805d-678ef86aef8b" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.227:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.102:49272 10.132.1.102:443 10.132.0.22:52628 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:42:35.071338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:45.847260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:52.046545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:57.897593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:07.153274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:43:13.549Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 75 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "beaa85b7-3763-4ca8-95d6-692187e73ce5" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:37954 10.132.1.102:443 10.132.0.22:37250 - v1-completions-path [2026-11-02T21:43:14.683Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e3976086-f766-4699-b628-082afdef23b9" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.102:42600 10.132.1.102:443 10.132.0.22:37254 - v1-completions-path 2026-11-02T21:43:30.335757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:41.099254Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:45.662177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:03.903548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:10.805814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:20.071506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:41.690353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:01.739556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:14.273435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:33.883186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:44.687103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:55.381577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:06.090275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:16.874916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:27.444829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8