2026-11-03T00:22:04.699399Z info FLAG: --concurrency="0" 2026-11-03T00:22:04.699417Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T00:22:04.699422Z info FLAG: --help="false" 2026-11-03T00:22:04.699424Z info FLAG: --log_as_json="false" 2026-11-03T00:22:04.699426Z info FLAG: --log_caller="" 2026-11-03T00:22:04.699429Z info FLAG: --log_output_level="default:info" 2026-11-03T00:22:04.699431Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T00:22:04.699435Z info FLAG: --log_target="[stdout]" 2026-11-03T00:22:04.699438Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T00:22:04.699440Z info FLAG: --outlierLogPath="" 2026-11-03T00:22:04.699442Z info FLAG: --profiling="true" 2026-11-03T00:22:04.699444Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T00:22:04.699446Z info FLAG: --proxyLogLevel="warning" 2026-11-03T00:22:04.699448Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T00:22:04.699450Z info FLAG: --stsPort="0" 2026-11-03T00:22:04.699452Z info FLAG: --templateFile="" 2026-11-03T00:22:04.699454Z info FLAG: --tokenManagerPlugin="" 2026-11-03T00:22:04.699457Z info FLAG: --vklog="0" 2026-11-03T00:22:04.699459Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T00:22:04.699611Z info Proxy role ips=[10.132.0.210] type=router id=maas-default-gateway-openshift-default-77bfb58f8c-gctbb.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T00:22:04.699661Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T00:22:04.700727Z info cpu limit detected as 2, setting concurrency 2026-11-03T00:22:04.700950Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T00:22:04.700961Z info JWT policy is third-party-jwt 2026-11-03T00:22:04.700964Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T00:22:04.702487Z info Starting default Istio SDS Server 2026-11-03T00:22:04.702520Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T00:22:04.702547Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T00:22:04.702955Z info Opening status port 15020 2026-11-03T00:22:04.704446Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T00:22:04.706018Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T00:22:04.706772Z info Starting proxy agent 2026-11-03T00:22:04.706803Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T00:22:04.707267Z info sds Starting SDS grpc server 2026-11-03T00:22:04.707283Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T00:22:04.772262Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T00:22:04.802497Z info cache generated new workload certificate resourceName=default latency=97.532242ms ttl=23h59m59.197508021s 2026-11-03T00:22:04.802533Z info cache Root cert has changed, start rotating root cert 2026-11-03T00:22:04.802568Z info cache returned workload trust anchor from cache ttl=23h59m59.197433121s 2026-11-03T00:22:04.922574Z info ads ADS: new connection for node:1 2026-11-03T00:22:04.922803Z info cache returned workload certificate from cache ttl=23h59m59.077199958s 2026-11-03T00:22:04.923793Z info ads ADS: new connection for node:2 2026-11-03T00:22:04.924229Z info cache returned workload trust anchor from cache ttl=23h59m59.075773618s 2026-11-03T00:22:05.008744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:22:13.227656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:22:14.192031Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T00:22:15.411935Z info Readiness succeeded in 10.71565727s 2026-11-03T00:22:15.412959Z info Envoy proxy is ready 2026-11-03T00:22:47.660599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:22:50.843Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 323 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4dc1d93e-9963-47fe-8900-c94c9a30b822" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:43854 10.132.0.210:443 10.132.0.10:50688 - v1-chat-completions-path [2026-11-03T00:22:51.547Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 63 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e9301717-0188-4242-aa6e-8ccc61d0bff6" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:43854 10.132.0.210:443 10.132.0.10:50694 - v1-chat-completions-path [2026-11-03T00:22:52.539Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 59 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "9b27ef83-7f13-430b-bb73-ff310b600cd3" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:43854 10.132.0.210:443 10.132.0.10:50702 - v1-chat-completions-path [2026-11-03T00:22:52.784Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 70 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "3e6b247d-d0f8-41c4-a2db-d63d813ebec3" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:43866 10.132.0.210:443 10.132.0.10:50710 - v1-chat-completions-path 2026-11-03T00:23:05.130214Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T00:23:05.130244Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T00:23:05.130247Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T00:23:05.130251Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T00:23:04.979Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 150 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8044a1c2-6c2e-42f1-8ae3-ed8672c1fe9a" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.210:443 10.132.0.10:46816 - v1-catch-all-path 2026-11-03T00:23:09.757305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:12.844819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T00:23:12.863971Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T00:23:12.787Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 76 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "870b8150-8b92-4ec0-b9fd-e2a4806d7f25" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:51638 10.132.0.210:443 10.132.0.10:35698 - v1-catch-all-path 2026-11-03T00:23:17.577764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:21.942013Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T00:23:21.806Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 135 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e68506b2-2ecf-49cc-8244-31adde8f5553" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:51638 10.132.0.210:443 10.132.0.10:34184 - v1-catch-all-path 2026-11-03T00:23:22.352776Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T00:23:22.234Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 118 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "83d83459-4deb-4778-9df0-8ea1d8133ae0" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:60362 10.132.0.210:443 10.132.0.10:34190 - v1-catch-all-path 2026-11-03T00:23:23.164106Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T00:23:23.070Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 93 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "84ab6d3a-deb7-45ed-a575-61234dd41d86" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:51638 10.132.0.210:443 10.132.0.10:34212 - v1-catch-all-path 2026-11-03T00:23:24.417435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T00:23:24.422491Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T00:23:24.298Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 124 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4707a4b7-051a-42ce-a551-6148e4f0716e" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:60362 10.132.0.210:443 10.132.0.10:34228 - v1-catch-all-path 2026-11-03T00:23:33.020105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:42.988742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:59.769222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:24:11.388144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:24:14.803773Z info ads ADS: new connection for node:3 2026-11-03T00:24:14.803992Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:24:14.804023Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:24:18.653844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:24:57.715665Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:25:00.968935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:25:00.968971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:25:00.968986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:25:00.968992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:25:00.842Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 126 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "b16f0637-ad5f-41b4-a206-55d1f5ab35b4" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:39644 10.132.0.210:443 10.132.0.10:48490 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T00:25:04.216Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 336 90 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "1085d50c-1380-4c81-bbfc-e10a08d51e32" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.217:8000" outbound|54321||e2e-prio-pool-78f9ed86-inference-pool-ip-18e30245.llm.svc.cluster.local 10.132.0.210:57460 10.132.0.210:443 10.132.0.10:48512 - v1-model-routing 2026-11-03T00:25:22.007059Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T00:25:22.464291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:25:26.830557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:25:26.830599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:25:26.830615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:25:26.830619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:25:27.407422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:25:26.709Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 333 121 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "bddb6649-e2d8-4d1b-b91d-882ca454b86f" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:39644 10.132.0.210:443 10.132.0.10:34784 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:25:43.368336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:27:55.225735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:55.225773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:55.225791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:27:55.225795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:27:55.112Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 113 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "f7c0b315-b461-4d05-ba3d-e7ec9d729cfe" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:41058 10.132.0.210:443 10.132.0.10:59542 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:27:57.393959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:57.394008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:57.394028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:27:57.394036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:27:57.341Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 52 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4e2c7847-0d1a-49d8-8241-49e2cf9f738a" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:41058 10.132.0.210:443 10.132.0.10:59554 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:28:17.484173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:28:43.655383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:09.640356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:23.533976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:30.509207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:41.206074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:46.231496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:30:04.680685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:30:07.545Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 78 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "407b5b72-7032-4507-b137-6d5be39813c8" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:47260 10.132.0.210:443 10.132.0.10:58532 - v1-completions-path [2026-11-03T00:30:35.520Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 75 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "1623944f-84aa-4c65-a151-3fd63b950e01" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:47260 10.132.0.210:443 10.132.0.10:43926 - v1-completions-path 2026-11-03T00:30:52.920452Z info ads ADS: new connection for node:4 2026-11-03T00:30:52.928337Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T00:30:52.928401Z info cache read certificate from file resource=file-root:system 2026-11-03T00:30:56.604308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:30:58.157015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:31:05.687251Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"193","StreamId":"17793842922854329211"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-11-03T00:31:05.623Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 64 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "24b0acb3-4bf1-48cb-9d68-5964b53d292f" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.0.210:443 10.132.0.10:36690 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T00:31:17.483780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:17.483812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:17.483823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:31:17.483830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:17.484034Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:31:17.280Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 203 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "48bd9e23-8d0f-4e90-bb90-779034ada84b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.210:41448 10.132.0.210:443 10.132.0.10:39124 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:31:24.632279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:24.632312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:24.632322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:24.632326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:31:24.632480Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:31:24.508Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 123 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "f7182f0d-df0b-4102-9ef2-65c8c1303138" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.210:41448 10.132.0.210:443 10.132.0.10:44798 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:31:27.031396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:27.031431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:27.031441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:27.031445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:31:27.031607Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:31:26.829Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 202 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "725a74e8-b2c9-4e52-8691-ae85ae43a1be" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.210:34464 10.132.0.210:443 10.132.0.10:44820 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:31:38.778702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:38.778738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:38.778747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:38.778752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:31:38.778914Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:31:38.650Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 128 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "2d101f8c-29cb-4462-8248-29b7b5a448f5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.210:41448 10.132.0.210:443 10.132.0.10:50956 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:31:43.510149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:43.510184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:43.510195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:31:43.510200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:43.510376Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:31:43.380Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 129 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e4db2ca4-822c-4245-8adf-2c800c32bede" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.210:41448 10.132.0.210:443 10.132.0.10:50966 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:32:16.574987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:32:16.575021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:32:16.575036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:32:16.575043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:32:16.575225Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:32:16.447Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 127 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8921255d-a320-45a7-adec-1b6e2b8d18de" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.210:41448 10.132.0.210:443 10.132.0.10:35484 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:32:50.456049Z info ads ADS: "" 4 terminated 2026-11-03T00:32:50.501488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:32:53.339572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:04.280171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:07.208252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:33:07.208289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:33:07.208304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:33:07.208310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:33:07.074Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 134 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "91b9eb94-6620-4ff6-a87d-bc0999e6a74d" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:36988 10.132.0.210:443 10.132.0.10:49794 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:33:23.028447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:28.026830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:33:31.904Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 75 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "fb43234f-69eb-4bf0-9a34-c35c9363562d" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33116 10.132.0.210:443 10.132.0.10:42628 - v1-completions-path [2026-11-03T00:33:32.428Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 60 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "133d53fd-1239-47b6-bbe9-45fcfed6b22f" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:42654 - v1-completions-path [2026-11-03T00:33:33.224Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 59 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "cc899156-4ec4-46f6-b396-74ab81c9e3db" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:42656 - v1-completions-path 2026-11-03T00:33:47.852986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:06.733769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:11.005207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:34:11.005244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:34:11.005260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:34:11.005265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:34:10.883Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 121 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "996bb664-e9d0-4bd7-ae55-56c9ce28ea94" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:58462 10.132.0.210:443 10.132.0.10:33628 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T00:34:12.320Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "074a77b2-70d1-4174-b1b5-3e1ac8645909" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:33648 - v1-completions-path [2026-11-03T00:34:13.931Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "791ceddb-6fe2-44df-8b23-5cf0119765c5" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:33652 - v1-completions-path [2026-11-03T00:34:14.176Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "7284d479-e9ab-4dd9-852e-4a22ef1690a9" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:33656 - v1-completions-path [2026-11-03T00:34:14.709Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "e7f07e7f-673f-4ff3-92ec-afc3e984df20" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:33670 - v1-completions-path [2026-11-03T00:34:16.262Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "0299d245-4748-4df3-8c87-dcfd8906d5ba" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33116 10.132.0.210:443 10.132.0.10:33674 - v1-completions-path 2026-11-03T00:34:35.668611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:46.440049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:51.258746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:03.276704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:35:03.276741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:35:03.276755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:35:03.276760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:35:03.158Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 118 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "afee683f-7f9b-4aa1-a391-47b7ddbb2a50" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:35266 10.132.0.210:443 10.132.0.10:59062 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:35:21.372689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:26.304012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:40.080099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:49.325229Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:57.269798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:06.758714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:16.452248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:35.074555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:43.187906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:53.600099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:56.628944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:36:56.628978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:36:56.628993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:36:56.628998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:36:56.515Z] "DELETE /v1/api-keys/e077e281-3683-4286-ae54-d60b4b23db46 HTTP/1.1" 404 - via_upstream - "-" 0 29 113 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "7a6efc88-7dbf-4a4b-ac92-78f922ec09c1" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:44588 10.132.0.210:443 10.132.0.10:54000 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:37:06.480258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:37:29.509183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:37:40.081533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:40:13.801351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:40:13.801399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:40:13.801423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:40:13.801430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:40:13.669Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 131 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "0b79c082-8ca1-45f3-b0e3-fc51937e506e" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:40856 10.132.0.210:443 10.132.0.10:54338 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:41:36.035066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:41:36.035116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:41:36.035143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:41:36.035151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:41:35.917Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 117 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "d1ffb2bd-ff48-4bd9-83fb-61428bf5c00c" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:41064 10.132.0.210:443 10.132.0.10:59858 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:41:59.153500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:16.376424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:20.809457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:42:23.860Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 68 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "1b529e67-ba02-463a-8f30-80b27f97355b" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:34406 10.132.0.210:443 10.132.0.10:60090 - v1-completions-path 2026-11-03T00:42:33.376297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:50.466170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:55.161687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:42:58.892Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "80fae9bb-f22b-4c17-b9c7-cd5520d34b98" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:48304 - v1-completions-path 2026-11-03T00:43:15.209993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:25.752168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:31.844239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:43:42.973Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "42a6f09c-e4f3-4a30-8b3d-cab3aa9487c8" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33116 10.132.0.210:443 10.132.0.10:42712 - v1-completions-path [2026-11-03T00:43:43.593Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "c0eec642-5f42-497c-9eef-b08583000c15" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:42724 - v1-completions-path 2026-11-03T00:43:45.601370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:43:45.601409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:43:45.601425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:43:45.601430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:43:45.485Z] "DELETE /v1/api-keys/d060485b-02b8-46cc-8128-0f2b4dfd75ab HTTP/1.1" 200 - via_upstream - "-" 0 365 116 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "0c1877e2-ff6e-439b-8d18-cdee01895bf3" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.231:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:54332 10.132.0.210:443 10.132.0.10:42746 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:43:59.008091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:04.999067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:10.671069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:44:19.197Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "6e70dbfa-09f0-4fbc-a915-2acd3fcf38d4" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:33582 - v1-completions-path [2026-11-03T00:44:19.952Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "d4a4c1f3-a713-4d15-b5dd-b1ecf00b0750" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33116 10.132.0.210:443 10.132.0.10:33598 - v1-completions-path [2026-11-03T00:44:26.023Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8b95d323-d039-4e9d-958a-8e5142fb5732" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33116 10.132.0.210:443 10.132.0.10:33610 - v1-completions-path 2026-11-03T00:44:41.801646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:52.545487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:58.906405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:04.865555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:17.084029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:45:23.578Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 66 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "6773f9d8-872c-46a2-9c44-2a72dead0676" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:33130 10.132.0.210:443 10.132.0.10:35060 - v1-completions-path 2026-11-03T00:45:40.394452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:51.404938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:56.298497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:13.628258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:23.523474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:44.053455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:06.046156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:28.099520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:48.105402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:59.133321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:48:09.799062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:48:20.535252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:48:31.388379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:48:41.832319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:48:41.832364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:48:41.832386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:48:41.832394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:48:42.058678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:48:41.698Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 134 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8edddcee-5996-44ef-9193-0d7b5e3eeb6a" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.248:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.210:44066 10.132.0.210:443 10.132.0.10:54188 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T00:48:53.060Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 78 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "2dc9642c-a08b-40d9-ac8f-e4f8aec8fd91" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:47260 10.132.0.210:443 10.132.0.10:41652 - v1-completions-path [2026-11-03T00:48:54.083Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 71 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "7ca0917d-b972-42fa-a131-b406d54909b2" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.210:34406 10.132.0.210:443 10.132.0.10:41678 - v1-completions-path 2026-11-03T00:49:27.226714Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2