2026-10-30T00:42:30.020226Z info FLAG: --concurrency="0" 2026-10-30T00:42:30.020246Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T00:42:30.020250Z info FLAG: --help="false" 2026-10-30T00:42:30.020252Z info FLAG: --log_as_json="false" 2026-10-30T00:42:30.020254Z info FLAG: --log_caller="" 2026-10-30T00:42:30.020256Z info FLAG: --log_output_level="default:info" 2026-10-30T00:42:30.020259Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T00:42:30.020263Z info FLAG: --log_target="[stdout]" 2026-10-30T00:42:30.020265Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T00:42:30.020268Z info FLAG: --outlierLogPath="" 2026-10-30T00:42:30.020270Z info FLAG: --profiling="true" 2026-10-30T00:42:30.020272Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T00:42:30.020274Z info FLAG: --proxyLogLevel="warning" 2026-10-30T00:42:30.020276Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T00:42:30.020278Z info FLAG: --stsPort="0" 2026-10-30T00:42:30.020280Z info FLAG: --templateFile="" 2026-10-30T00:42:30.020282Z info FLAG: --tokenManagerPlugin="" 2026-10-30T00:42:30.020284Z info FLAG: --vklog="0" 2026-10-30T00:42:30.020287Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T00:42:30.020452Z info Proxy role ips=[10.132.0.41] type=router id=maas-default-gateway-openshift-default-7d9897b54c-pdgh4.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T00:42:30.020500Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T00:42:30.021538Z info cpu limit detected as 2, setting concurrency 2026-10-30T00:42:30.021728Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T00:42:30.021738Z info JWT policy is third-party-jwt 2026-10-30T00:42:30.021741Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T00:42:30.022998Z info Starting default Istio SDS Server 2026-10-30T00:42:30.023025Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T00:42:30.023057Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T00:42:30.023478Z info Opening status port 15020 2026-10-30T00:42:30.024436Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T00:42:30.024904Z info sds Starting SDS grpc server 2026-10-30T00:42:30.024937Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T00:42:30.025646Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T00:42:30.026690Z info Starting proxy agent 2026-10-30T00:42:30.026721Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T00:42:30.089220Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T00:42:30.125642Z info cache generated new workload certificate resourceName=default latency=100.639667ms ttl=23h59m59.874361874s 2026-10-30T00:42:30.125675Z info cache Root cert has changed, start rotating root cert 2026-10-30T00:42:30.125705Z info cache returned workload trust anchor from cache ttl=23h59m59.874295034s 2026-10-30T00:42:30.196710Z info ads ADS: new connection for node:1 2026-10-30T00:42:30.197131Z info cache returned workload certificate from cache ttl=23h59m59.802870806s 2026-10-30T00:42:30.197234Z info ads ADS: new connection for node:2 2026-10-30T00:42:30.197293Z info cache returned workload trust anchor from cache ttl=23h59m59.802708798s 2026-10-30T00:42:30.279677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:42:38.178760Z info Readiness succeeded in 8.160751194s 2026-10-30T00:42:38.179145Z info Envoy proxy is ready 2026-10-30T00:42:45.420862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:42:45.420911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:42:45.420933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T00:42:45.420940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T00:42:45.326Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 94 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "930ce29c-b5ee-4136-adbf-ec106ac8bba7" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.41:44980 10.132.0.41:443 10.132.0.9:42884 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T00:42:46.393Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 49 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "1344dc78-47a5-4424-a57e-4a3e85d39f6e" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.41:443 10.132.0.9:42904 - v1-model-routing 2026-10-30T00:45:09.032298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T00:45:09.032340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T00:45:09.032354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T00:45:09.032359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T00:45:08.260Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 60 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "7c05fef8-29a6-47e3-8b15-95a4e7c3a607" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.41:443 10.132.0.9:40362 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T00:45:08.949Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 82 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "ba3dff82-032b-4bd1-88e4-66ff877b2a43" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.41:52802 10.132.0.41:443 10.132.0.9:40370 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:45:09.478144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:45:09.478178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:45:09.478191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:45:09.478196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T00:45:09.408Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 69 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "c7490281-94f9-4663-b7d4-7bda98696863" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.41:52804 10.132.0.41:443 10.132.0.9:40382 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:45:18.206345Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T00:45:18.206371Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T00:45:18.206375Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T00:45:18.206399Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-10-30T00:45:17.705Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 104 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "d3e48e5a-061e-4440-9895-2d52c376fa56" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:47168 10.132.0.41:443 10.132.0.9:41750 - v1-completions-path [2026-10-30T00:45:18.170Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 36 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "2bfcecd4-372a-41f5-bba5-128e1bc3c257" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.41:443 10.132.0.9:41766 - v1-completions-path 2026-10-30T00:45:25.396324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:45:39.509449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T00:50:33.362Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 27 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "04e890f0-2447-469a-b9d4-0371948f6c68" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.41:443 10.132.0.9:59526 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:51:52.220326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:53:32.951652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:53:52.607031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:55:35.160475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:13:26.420161Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T01:20:16.369007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:20:16.369047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:20:16.369061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T01:20:16.369066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T01:20:16.280Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 88 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "9498887f-a1b4-4ba8-b1d3-ac6f60bd3540" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.41:46094 10.132.0.41:443 10.132.0.9:51938 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:24:36.740375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:24:38.895318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:24:38.895360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:24:38.895374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T01:24:38.895397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-30T01:24:38.817Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 78 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e4c9808e-f242-4871-bdcc-890f67836eaa" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.41:56242 10.132.0.41:443 10.132.0.9:32906 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:25:02.307877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:25:45.876029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:25:50.055Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 72 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "83504d43-1ede-40b1-b097-864711d613cb" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:53458 10.132.0.41:443 10.132.0.9:44594 - v1-completions-path 2026-10-30T01:26:02.970405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:26:07.793872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:26:26.277671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:26:28.838416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:26:31.807418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:26:41.820336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:26:48.228Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "007366c0-4ae1-470a-896b-48dc0587ad9d" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:43170 10.132.0.41:443 10.132.0.9:39904 - v1-completions-path 2026-10-30T01:26:49.457974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T01:26:48.783Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 55 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "d5bdef35-50dc-4055-a462-9f222d17ef17" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:53458 10.132.0.41:443 10.132.0.9:39908 - v1-completions-path [2026-10-30T01:26:49.406Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 52 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "3912c921-405e-486e-bdbd-ab6179f67662" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:43170 10.132.0.41:443 10.132.0.9:39924 - v1-completions-path 2026-10-30T01:27:05.330790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:27:15.905136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:27:20.380885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:27:25.335Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "197517f1-9b4d-4f3f-9387-621486396a47" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:43170 10.132.0.41:443 10.132.0.9:37122 - v1-completions-path [2026-10-30T01:27:25.580Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 55 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "b810e60a-d444-411a-8605-d429b07a0a54" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:43170 10.132.0.41:443 10.132.0.9:37136 - v1-completions-path 2026-10-30T01:27:25.781803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-10-30T01:27:25.727Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "0c1a2e22-4a29-4447-b010-d0e3d07b5542" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:53458 10.132.0.41:443 10.132.0.9:37142 - v1-completions-path 2026-10-30T01:27:38.501024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:27:40.842113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:28:00.178208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:28:05.206270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:28:21.720763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:28:36.460Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 65 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "4559b571-14ff-4727-ad82-1080bf6e0205" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:44616 10.132.0.41:443 10.132.0.9:37158 - v1-completions-path 2026-10-30T01:28:37.722551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:28:48.523149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:28:51.382626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:29:08.746Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 37 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "8be125f3-7801-43d4-afbe-b3fef6f40cd0" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.41:443 10.132.0.9:50330 - v1-completions-path 2026-10-30T01:29:10.911883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:29:13.743519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:29:34.947994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:29:37.630519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:31:13.669351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:31:17.834173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:32:52.198956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:07.485630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:09.738715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:24.343424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:44.089881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:00.047073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:20.602676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:34.539034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:40.609070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:53.178352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:56.497576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:16.704043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:26.410320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:32.049199Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T01:36:31.978Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 71 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "9dae00a8-4a07-47ec-9376-0c52ae684c8b" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:37576 10.132.0.41:443 10.132.0.9:43864 - v1-catch-all-model-routing 2026-10-30T01:36:34.678871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:39.113607Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-30T01:36:39.053Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 60 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "78bb1673-6636-4d86-b892-dc879851ded7" "maas.apps.e6e4360c00b8dff8d7d4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:37580 10.132.0.41:443 10.132.0.9:49892 - v1-catch-all-path 2026-10-30T01:36:48.438223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:50.632214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:37:02.956900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:37:13.823115Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8