2026-10-30T12:56:11.578942Z info FLAG: --concurrency="0" 2026-10-30T12:56:11.578961Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T12:56:11.578966Z info FLAG: --help="false" 2026-10-30T12:56:11.578970Z info FLAG: --log_as_json="false" 2026-10-30T12:56:11.578972Z info FLAG: --log_caller="" 2026-10-30T12:56:11.578976Z info FLAG: --log_output_level="default:info" 2026-10-30T12:56:11.578979Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T12:56:11.578986Z info FLAG: --log_target="[stdout]" 2026-10-30T12:56:11.578990Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T12:56:11.578993Z info FLAG: --outlierLogPath="" 2026-10-30T12:56:11.578996Z info FLAG: --profiling="true" 2026-10-30T12:56:11.578998Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T12:56:11.579001Z info FLAG: --proxyLogLevel="warning" 2026-10-30T12:56:11.579004Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T12:56:11.579007Z info FLAG: --stsPort="0" 2026-10-30T12:56:11.579010Z info FLAG: --templateFile="" 2026-10-30T12:56:11.579013Z info FLAG: --tokenManagerPlugin="" 2026-10-30T12:56:11.579016Z info FLAG: --vklog="0" 2026-10-30T12:56:11.579020Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T12:56:11.579201Z info Proxy role ips=[10.132.0.44] type=router id=maas-default-gateway-openshift-default-58c6585447-ddspx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T12:56:11.579279Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T12:56:11.580792Z info cpu limit detected as 2, setting concurrency 2026-10-30T12:56:11.581017Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T12:56:11.581032Z info JWT policy is third-party-jwt 2026-10-30T12:56:11.581036Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T12:56:11.583058Z info Starting default Istio SDS Server 2026-10-30T12:56:11.583090Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T12:56:11.583114Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T12:56:11.583384Z info Opening status port 15020 2026-10-30T12:56:11.584196Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T12:56:11.585127Z info sds Starting SDS grpc server 2026-10-30T12:56:11.585232Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T12:56:11.585680Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T12:56:11.586844Z info Starting proxy agent 2026-10-30T12:56:11.586881Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T12:56:11.653603Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T12:56:11.753657Z info ads ADS: new connection for node:1 2026-10-30T12:56:11.754132Z info ads ADS: new connection for node:2 2026-10-30T12:56:11.783964Z info cache generated new workload certificate resourceName=default latency=198.610494ms ttl=23h59m59.21603989s 2026-10-30T12:56:11.784000Z info cache Root cert has changed, start rotating root cert 2026-10-30T12:56:11.784034Z info cache returned workload trust anchor from cache ttl=23h59m59.215966923s 2026-10-30T12:56:11.784051Z info cache returned workload certificate from cache ttl=23h59m59.215949565s 2026-10-30T12:56:11.784149Z info cache returned workload trust anchor from cache ttl=23h59m59.215856215s 2026-10-30T12:56:11.784428Z info cache returned workload trust anchor from cache ttl=23h59m59.215572916s 2026-10-30T12:56:11.826768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:56:17.546429Z info Readiness succeeded in 5.970567745s 2026-10-30T12:56:17.546834Z info Envoy proxy is ready 2026-10-30T12:56:27.595360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:07.741691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:10.076721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:12.804688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:16.974005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:19.680193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:22.837458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:46.675752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T12:58:23.799Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 64 - "34.228.250.194,10.132.0.16" "curl/7.76.1" "240ccc56-fb35-42e7-80f3-5d73467638ed" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.44:443 10.132.0.16:40902 - v1-model-routing 2026-10-30T12:58:24.575191Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T12:58:24.575219Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T12:58:24.575222Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T12:58:24.575225Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 2026-10-30T12:58:24.676717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:58:24.676752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:58:24.676767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T12:58:24.676772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T12:58:24.552Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 22 - "34.228.250.194,10.132.0.16" "curl/7.76.1" "405f63a3-763f-4d16-8e72-b808cb564102" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.44:443 10.132.0.16:40904 - v1-model-routing [2026-10-30T12:58:24.601Z] "DELETE /v1/api-keys/55df0d5b-a797-4fa8-bf7c-19a9d05b1f2c HTTP/1.1" 200 - via_upstream - "-" 0 365 75 - "34.228.250.194,10.132.0.16" "curl/7.76.1" "606ad76e-f93e-4129-8130-d9ffddaa4b2f" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.44:47172 10.132.0.44:443 10.132.0.16:40912 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:00:41.414736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:00:41.414773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:00:41.414787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:00:41.414792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:00:41.199Z] "DELETE /v1/api-keys/bfd6256d-8409-4cd7-9a00-85679af054af HTTP/1.1" 200 - via_upstream - "-" 0 321 215 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "2e53a0c2-e081-4997-8436-94e686b38210" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.44:32978 10.132.0.44:443 10.132.0.16:39578 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:00:45.290569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:00:45.290618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:00:45.290636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:00:45.290643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T13:00:45.759955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:00:45.759999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:00:45.760020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:00:45.760027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:00:45.190Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 100 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "49550f17-ccf4-459d-80fb-8cee3147fa0a" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.44:32978 10.132.0.44:443 10.132.0.16:39602 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:00:45.675Z] "DELETE /v1/api-keys/282ba3ec-6cab-4ba1-821a-24bae5a5cbc0 HTTP/1.1" 200 - via_upstream - "-" 0 321 84 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "e8dd6c4e-49bc-478b-9868-335842b1ffcb" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.44:32988 10.132.0.44:443 10.132.0.16:39616 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:00:51.919121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:00:56.527822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:00:56.527854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:00:56.527866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:00:56.527871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T13:00:56.516Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 11 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "fccbd80a-1512-4217-91ac-dc443ba9b6a3" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.44:32988 10.132.0.44:443 10.132.0.16:42154 - odh-ai-gateway-infra.maas-api-route.4 [2026-10-30T13:01:04.966Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 43 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "1b7bb50a-914f-4a28-b56a-5fc0dcd43720" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.44:443 10.132.0.16:35938 - v1-completions-path 2026-10-30T13:01:08.903987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:04:36.231983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:04:36.232161Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T13:04:36.001Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 334 142 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "6c4c7dee-f19d-4a24-ad71-8b8c45b95138" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:55534 10.132.0.44:443 10.132.0.16:49652 - v1-chat-completions-path [2026-10-30T13:04:36.172Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 4131 60 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "e350e737-0964-41a5-b3f9-34d1e7d16024" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:55534 10.132.0.44:443 10.132.0.16:49668 - v1-chat-completions-path 2026-10-30T13:05:05.829409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:05:30.914924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:07:02.373250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:10:35.393367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:11:06.864478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:12:51.038809Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:15:05.634007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:15:45.844853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:27:10.120221Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T13:43:27.676470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:43:29.761864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:43:29.761910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:43:29.761924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T13:43:29.761929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T13:43:29.674Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 87 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "9c98a5ae-59d1-4477-bc86-d37b12e2afb3" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.44:41238 10.132.0.44:443 10.132.0.16:42550 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:43:53.681933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:44:05.115803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T13:44:05.186776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:44:05.186808Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:44:05.186820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:44:05.186825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T13:44:05.108Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 78 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "21a3f6e2-fe5f-4d55-bb9d-a8d9e2ae3cca" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.44:47236 10.132.0.44:443 10.132.0.16:53814 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:44:35.310076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:44:40.522Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "982bdb11-de90-4096-88cd-0e16f5e3073a" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50676 10.132.0.44:443 10.132.0.16:43784 - v1-completions-path [2026-10-30T13:44:40.724Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 55 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "a349baa7-7463-4ee4-b6e2-d333a5a76357" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50676 10.132.0.44:443 10.132.0.16:43800 - v1-completions-path 2026-10-30T13:44:53.454065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:44:57.759150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:13.728139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:16.271546Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:18.909859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:29.568924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:45:35.215Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 68 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "c6c19245-ec0e-4681-b4de-02a2f6376e3f" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50676 10.132.0.44:443 10.132.0.16:44898 - v1-completions-path 2026-10-30T13:45:37.061028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T13:45:37.002Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "ecd18a95-6fe0-49e8-974c-47846493f927" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50072 10.132.0.44:443 10.132.0.16:44900 - v1-completions-path [2026-10-30T13:45:37.245Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "c2ebf5a4-d61a-4c3c-b8b3-e636936623f8" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50072 10.132.0.44:443 10.132.0.16:44904 - v1-completions-path 2026-10-30T13:45:53.202546Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:03.609261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:07.969954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:46:12.168Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "2a0873b8-c1b0-4e5d-98fe-b015b4d0ea08" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50676 10.132.0.44:443 10.132.0.16:57960 - v1-completions-path [2026-10-30T13:46:12.254Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "e175539d-9e14-4699-9d45-9aa9a8cb2b3e" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50072 10.132.0.44:443 10.132.0.16:57964 - v1-completions-path [2026-10-30T13:46:12.414Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 55 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "8449397f-443d-4e8b-b7da-62d7b5526a75" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50072 10.132.0.44:443 10.132.0.16:57976 - v1-completions-path [2026-10-30T13:46:12.655Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "6fd50d2e-a13b-47e3-9cd7-00bfada4af17" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50072 10.132.0.44:443 10.132.0.16:57984 - v1-completions-path [2026-10-30T13:46:13.075Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "4a1e80f4-2e10-4f26-81c5-12e3718e24bb" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:50676 10.132.0.44:443 10.132.0.16:57998 - v1-completions-path 2026-10-30T13:46:25.279050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:27.399315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:46.799983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:46:51.701459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:08.052661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:25.143374Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:35.887556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:47:38.750189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:47:45.361Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 64 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "4e9ad958-277b-4a70-9a81-f287eb0656aa" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:53016 10.132.0.44:443 10.132.0.16:43792 - v1-completions-path [2026-10-30T13:48:00.040Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 64 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "43b80fd0-7e9e-4c41-b56e-65335f39d305" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:55534 10.132.0.44:443 10.132.0.16:46760 - v1-completions-path 2026-10-30T13:51:15.009937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:51:15.652Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 288 130 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "36abeb59-cf58-4d02-af0d-88aded1bf319" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:60150 10.132.0.44:443 10.132.0.16:35740 - v1-completions-path 2026-10-30T13:51:29.619495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:31.950334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:46.442177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:06.780556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:25.189591Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:39.418735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:51.364895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:54.968800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:53:54.968836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:53:54.968851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:53:54.968856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:53:55.179246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:53:54.886Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 82 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "ef0f6f57-d70c-413f-996e-ba8034a5acba" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.44:39206 10.132.0.44:443 10.132.0.16:60008 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:53:57.650506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:06.930758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:11.143222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:29.669376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:37.407530Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:54:37.407556Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:54:37.407559Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T13:54:37.407563Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T13:54:37.337Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 70 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "4c0d1d80-eb0d-402a-8daf-0ecd0527a764" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.44:443 10.132.0.16:49658 - v1-catch-all-path 2026-10-30T13:54:39.693964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:45.379797Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T13:54:45.288Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 91 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "13f302f6-9d21-4db9-88c4-b27690935547" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:56754 10.132.0.44:443 10.132.0.16:46826 - v1-catch-all-path 2026-10-30T13:54:48.239637Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:53.904748Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T13:54:53.843Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 61 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "a3000825-a8d7-4848-af96-4169e5477d2e" "maas.apps.c8f47798e68494ae1bd3.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.44:56754 10.132.0.44:443 10.132.0.16:35532 - v1-catch-all-path 2026-10-30T13:55:01.237620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:03.328026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:17.961851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:28.832385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8