2026-11-03T12:55:11.546564Z info FLAG: --concurrency="0" 2026-11-03T12:55:11.546584Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T12:55:11.546590Z info FLAG: --help="false" 2026-11-03T12:55:11.546593Z info FLAG: --log_as_json="false" 2026-11-03T12:55:11.546596Z info FLAG: --log_caller="" 2026-11-03T12:55:11.546599Z info FLAG: --log_output_level="default:info" 2026-11-03T12:55:11.546602Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T12:55:11.546608Z info FLAG: --log_target="[stdout]" 2026-11-03T12:55:11.546612Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T12:55:11.546615Z info FLAG: --outlierLogPath="" 2026-11-03T12:55:11.546619Z info FLAG: --profiling="true" 2026-11-03T12:55:11.546622Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T12:55:11.546625Z info FLAG: --proxyLogLevel="warning" 2026-11-03T12:55:11.546628Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T12:55:11.546631Z info FLAG: --stsPort="0" 2026-11-03T12:55:11.546634Z info FLAG: --templateFile="" 2026-11-03T12:55:11.546636Z info FLAG: --tokenManagerPlugin="" 2026-11-03T12:55:11.546640Z info FLAG: --vklog="0" 2026-11-03T12:55:11.546644Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T12:55:11.546872Z info Proxy role ips=[10.134.0.148] type=router id=maas-default-gateway-openshift-default-7f5667f86c-lxmnf.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T12:55:11.546932Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T12:55:11.548059Z info cpu limit detected as 2, setting concurrency 2026-11-03T12:55:11.548279Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T12:55:11.548294Z info JWT policy is third-party-jwt 2026-11-03T12:55:11.548299Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T12:55:11.550045Z info Starting default Istio SDS Server 2026-11-03T12:55:11.550075Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T12:55:11.550360Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T12:55:11.550501Z info Opening status port 15020 2026-11-03T12:55:11.551220Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T12:55:11.553101Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T12:55:11.554861Z info sds Starting SDS grpc server 2026-11-03T12:55:11.554880Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T12:55:11.555056Z info Starting proxy agent 2026-11-03T12:55:11.555092Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T12:55:11.624048Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T12:55:11.746005Z info cache generated new workload certificate resourceName=default latency=194.582974ms ttl=23h59m59.25400091s 2026-11-03T12:55:11.746098Z info cache Root cert has changed, start rotating root cert 2026-11-03T12:55:11.746140Z info cache returned workload trust anchor from cache ttl=23h59m59.253860646s 2026-11-03T12:55:11.853448Z info ads ADS: new connection for node:1 2026-11-03T12:55:11.857427Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T12:55:11.857477Z info cache read certificate from file resource=file-root:system 2026-11-03T12:55:11.884194Z info ads ADS: new connection for node:2 2026-11-03T12:55:11.884265Z info cache returned workload certificate from cache ttl=23h59m59.11573602s 2026-11-03T12:55:11.884852Z info ads ADS: new connection for node:3 2026-11-03T12:55:11.885006Z info cache returned workload trust anchor from cache ttl=23h59m59.114995159s 2026-11-03T12:55:11.980907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T12:55:20.254499Z info Readiness succeeded in 8.710349172s 2026-11-03T12:55:20.254921Z info Envoy proxy is ready 2026-11-03T12:56:20.986995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T12:57:06.556443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T12:58:16.645Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 92 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "bace8b91-a670-436c-9d75-c0e5198deb29" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:42016 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T12:58:37.770Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 69 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "6288e4c9-4ef3-42a8-ae2c-0319f9602ccd" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:38440 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T12:58:53.779Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 80 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "071647d7-e563-4aa2-a3e1-8e04ed983150" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:42724 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T12:59:14.894Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 73 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "c806cd37-7556-40b3-bbcb-3de038b92ae0" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:53860 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T12:59:25.571Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 77 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "49ad15f2-1a78-4b46-b615-8f7eab5049e7" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:40876 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T12:59:30.843Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 93 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "ff7b886d-2bb0-4c38-a9d3-18600ddc4262" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:33040 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T12:59:41.405Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 96 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "883bba3e-66ed-44e7-9cd9-104e51806780" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:56942 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 2026-11-03T12:59:46.756232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-03T12:59:46.690Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 68 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "cef5db73-8ce0-440c-a6f2-3bb454b94c71" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:56952 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T13:00:02.660Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 78 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "0da18c10-2990-49c5-82f1-023d95d0bb6d" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:39076 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 2026-11-03T13:00:13.307900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T13:00:13.235Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 78 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "c7daf6ee-4130-488a-afd2-4783d0d9cdbf" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:38148 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T13:00:39.822Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 79 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "770640ef-117d-429f-95d3-92d178c7fabc" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:37892 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T13:01:38.100Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 503 - - "-" 109 0 79 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "05490572-4c4c-4ed0-ab30-4b63b83bad3d" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:50280 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 [2026-11-03T13:01:43.395Z] "POST /llm/e2e-dft-c7826d/anything/e2e-dft-c7826d-03302b HTTP/1.1" 403 - - "-" 109 77 42 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "8660fc72-aa3d-4793-97e5-e24cb83b7833" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-c7826d.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:50304 - llm.external-model-e2e-dft-c7826d-243f7d95ce80.2 2026-11-03T13:01:44.712113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:01:56.037422Z info ads ADS: "" 1 terminated with stream closed 2026-11-03T13:01:57.119083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:01:59.001765Z info ads ADS: new connection for node:4 2026-11-03T13:01:59.005118Z info cache read certificate from file resource=file-root:system 2026-11-03T13:02:02.958996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:02:04.785448Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T13:02:06.474121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:02:11.394677Z info ads ADS: new connection for node:5 2026-11-03T13:02:11.398369Z info cache read certificate from file resource=file-root:system 2026-11-03T13:02:14.669993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:02:17.425615Z info ads ADS: "" 5 terminated with stream closed 2026-11-03T13:02:18.410893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:02:35.434114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:05:05.577063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:06:36.538787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:07:12.128934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:08:29.169771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:20:48.007233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:20:48.007275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:20:48.007293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:20:48.007298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T13:20:47.831Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 176 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "31e7d5ed-e1ee-4996-b9df-019f0f77ad64" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.148:55426 10.134.0.148:443 10.132.0.20:43296 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:20:52.521270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:21:22.943238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:21:32.155762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:21:32.155797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:21:32.155810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:21:32.155815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T13:21:32.049Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 106 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "64fd2fc7-af19-4a1d-94eb-2800b5a38322" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.148:55426 10.134.0.148:443 10.132.0.20:59954 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:22:01.779401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T13:22:05.709Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 340 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "248bb03a-dca7-436d-96c6-aa84bc29b58a" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.37:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:52804 10.134.0.148:443 10.132.0.20:48608 - v1-chat-completions-path [2026-11-03T13:22:06.458Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 67 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "70829397-1f4a-45c2-b4ce-79bfc7f8710b" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.37:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:52812 10.134.0.148:443 10.132.0.20:48622 - v1-chat-completions-path 2026-11-03T13:22:22.060824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:22:27.380811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:22:31.534978Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T13:22:31.336Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 198 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "3db77a09-2782-4548-87aa-e6d3cf0a62ec" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:43896 10.134.0.148:443 10.132.0.20:47564 - v1-catch-all-model-routing 2026-11-03T13:22:37.296452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:22:41.181313Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-03T13:22:41.112Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 68 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "3fe57a43-8bb2-4c7f-87b3-dea1dfffa8fd" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:59622 10.134.0.148:443 10.132.0.20:55862 - v1-catch-all-path 2026-11-03T13:22:50.945586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:22:59.545474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:23:11.585210Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T13:23:16.356910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:23:28.117290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:23:32.040766Z info ads ADS: new connection for node:6 2026-11-03T13:23:32.041212Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T13:23:32.041280Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T13:23:35.044549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:24:19.207659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:24:43.341153Z info ads ADS: "" 6 terminated 2026-11-03T13:24:43.740127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:24:48.652613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:25:05.071244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:27:37.103804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:28:00.887762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:28:27.035086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:28:42.367813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:28:50.846074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:28:57.455926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:29:06.837666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:29:12.419586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:29:31.838907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:30:19.969670Z info ads ADS: new connection for node:7 2026-11-03T13:30:19.974855Z info cache read certificate from file resource=file-root:system 2026-11-03T13:30:23.856816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:30:24.957522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:30:30.285456Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"592","StreamId":"16940373296963033763"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=26 [2026-11-03T13:30:30.211Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 73 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "d88bc0cd-9c32-43fa-a5ee-3f056a6f9013" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.148:443 10.132.0.20:41688 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T13:30:39.642415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:30:39.642450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:30:39.642464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:30:39.642470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:30:39.642674Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T13:30:39.449Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 193 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "a89b772e-4d84-4729-9127-273f723b95a1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.148:36582 10.134.0.148:443 10.132.0.20:41500 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T13:30:46.733113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:30:46.733149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:30:46.733162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:30:46.733168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:30:46.733365Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T13:30:46.607Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 125 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "9d9748ec-6066-4ae1-9d63-8acf2251182f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.148:36582 10.134.0.148:443 10.132.0.20:41514 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T13:31:08.212492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:31:08.212523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:31:08.212533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:31:08.212538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:31:08.212704Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T13:31:08.086Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 126 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "8b095c1b-526b-4bde-a1ae-e828faf8b89b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.148:36582 10.134.0.148:443 10.132.0.20:40688 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T13:31:10.587532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:10.587562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:10.587571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T13:31:10.587576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T13:31:10.587741Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T13:31:10.396Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 191 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "4884dcde-1b62-492f-8e0d-01e8088a7474" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.148:38242 10.134.0.148:443 10.132.0.20:40718 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T13:31:19.940280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:31:19.940315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:31:19.940326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:31:19.940330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T13:31:19.940511Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T13:31:19.807Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 133 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "062b0e15-14eb-4e87-b90f-84c953d26404" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.148:36582 10.134.0.148:443 10.132.0.20:46858 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T13:32:08.818170Z info ads ADS: "" 7 terminated 2026-11-03T13:32:08.870780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:32:11.480810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:32:22.025463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:32:40.214943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:32:44.849859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T13:32:50.011Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 80 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "5dad393a-660a-4574-a046-1bddbcca72a5" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:44542 10.134.0.148:443 10.132.0.20:59780 - v1-completions-path [2026-11-03T13:33:03.838Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 82 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "f0b64eff-ab36-4569-af27-e1fa9920d454" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:41690 10.134.0.148:443 10.132.0.20:42514 - v1-completions-path 2026-11-03T13:33:08.911413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:33:22.117041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T13:33:32.052Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "495b89cd-b2d3-483f-882a-ff1f2e11d01b" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:44542 10.134.0.148:443 10.132.0.20:46718 - v1-completions-path [2026-11-03T13:33:34.033Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "de400b8f-e8bc-47cf-9548-3eef8d1491af" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:44542 10.134.0.148:443 10.132.0.20:46732 - v1-completions-path 2026-11-03T13:33:52.366907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:34:03.003398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:34:09.428288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:34:37.610662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:34:42.327070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:34:55.799796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:05.832746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:15.283901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:24.419427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:33.832339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:51.104411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:35:56.990931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:36:15.074245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T13:36:17.382Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 61 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "cea8811b-35ae-4e92-a1ef-c73df8177d05" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.148:443 10.132.0.20:52128 - v1-completions-path 2026-11-03T13:36:20.581776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:36:32.316455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:36:58.445397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:37:09.079570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:37:33.213882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:37:39.199854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:40:38.028277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:42:06.246774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:42:23.406489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:42:28.010531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:42:40.607848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:42:58.072523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:43:04.328694Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:43:10.592241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:43:10.592280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:43:10.592298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:43:10.592303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T13:43:09.897Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "0d2b37e7-c684-4644-9096-4bf39e715b2a" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:44542 10.134.0.148:443 10.132.0.20:54844 - v1-completions-path [2026-11-03T13:43:10.449Z] "DELETE /v1/api-keys/02af5fc6-7554-434f-b36d-e11db558ef64 HTTP/1.1" 200 - via_upstream - "-" 0 369 142 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "219c2e87-9e3b-41b7-acd6-2c7afc0f6454" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.238:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.148:42308 10.134.0.148:443 10.132.0.20:54860 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T13:43:24.014336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:43:34.835898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:43:40.926901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:43:49.789116Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T13:44:08.161349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:44:14.331055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:44:20.010677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:44:27.018772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:44:27.018809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:44:27.018826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T13:44:27.018831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T13:44:26.907Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 111 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "81377233-6b36-4b63-9b08-6f12b932d531" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.238:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.148:42886 10.134.0.148:443 10.132.0.20:38756 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T13:44:28.382Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "f1520617-4660-43ab-9a85-903b82505969" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:42632 10.134.0.148:443 10.132.0.20:43778 - v1-completions-path [2026-11-03T13:44:31.477Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "b9fd7967-7290-43cf-b784-1afc7fa1c478" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:42632 10.134.0.148:443 10.132.0.20:43788 - v1-completions-path 2026-11-03T13:44:50.690497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:45:01.468920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:45:07.702886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:45:15.262178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:45:26.136279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T13:45:34.895Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "44.212.242.249,10.132.0.20" "python-requests/2.34.2" "4c28874d-d988-4ad6-971b-4e13a25f1f99" "maas.apps.3c315f49dfe0b1b71593.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.148:44542 10.134.0.148:443 10.132.0.20:49844 - v1-completions-path 2026-11-03T13:45:49.461683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:46:00.278442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:46:04.959052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:46:23.047837Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:46:29.950177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:46:50.286571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:47:11.983076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:47:33.465575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:47:53.856931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:48:04.783026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:48:15.502191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:48:26.216651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:48:37.110490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T13:48:47.795017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8