2026-10-31T19:49:52.945985Z info FLAG: --concurrency="0" 2026-10-31T19:49:52.946021Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T19:49:52.946027Z info FLAG: --help="false" 2026-10-31T19:49:52.946030Z info FLAG: --log_as_json="false" 2026-10-31T19:49:52.946033Z info FLAG: --log_caller="" 2026-10-31T19:49:52.946036Z info FLAG: --log_output_level="default:info" 2026-10-31T19:49:52.946039Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T19:49:52.946045Z info FLAG: --log_target="[stdout]" 2026-10-31T19:49:52.946049Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T19:49:52.946052Z info FLAG: --outlierLogPath="" 2026-10-31T19:49:52.946055Z info FLAG: --profiling="true" 2026-10-31T19:49:52.946058Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T19:49:52.946061Z info FLAG: --proxyLogLevel="warning" 2026-10-31T19:49:52.946064Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T19:49:52.946067Z info FLAG: --stsPort="0" 2026-10-31T19:49:52.946070Z info FLAG: --templateFile="" 2026-10-31T19:49:52.946072Z info FLAG: --tokenManagerPlugin="" 2026-10-31T19:49:52.946076Z info FLAG: --vklog="0" 2026-10-31T19:49:52.946081Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T19:49:52.946275Z info Proxy role ips=[10.134.0.238] type=router id=maas-default-gateway-openshift-default-7f694df8bc-mjzjn.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T19:49:52.946332Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T19:49:52.947512Z info cpu limit detected as 2, setting concurrency 2026-10-31T19:49:52.947741Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T19:49:52.947756Z info JWT policy is third-party-jwt 2026-10-31T19:49:52.947761Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T19:49:52.949590Z info Starting default Istio SDS Server 2026-10-31T19:49:52.949614Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T19:49:52.949645Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T19:49:52.949960Z info Opening status port 15020 2026-10-31T19:49:52.950914Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T19:49:52.951287Z info sds Starting SDS grpc server 2026-10-31T19:49:52.951304Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T19:49:52.952229Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T19:49:52.953028Z info Starting proxy agent 2026-10-31T19:49:52.953057Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T19:49:53.019588Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T19:49:53.169431Z info ads ADS: new connection for node:1 2026-10-31T19:49:53.169695Z info ads ADS: new connection for node:2 2026-10-31T19:49:53.179143Z info cache generated new workload certificate resourceName=default latency=227.7018ms ttl=23h59m59.820860679s 2026-10-31T19:49:53.179178Z info cache Root cert has changed, start rotating root cert 2026-10-31T19:49:53.179207Z info cache returned workload certificate from cache ttl=23h59m59.820798169s 2026-10-31T19:49:53.179227Z info cache returned workload trust anchor from cache ttl=23h59m59.820773636s 2026-10-31T19:49:53.179312Z info cache returned workload trust anchor from cache ttl=23h59m59.820688181s 2026-10-31T19:49:53.179593Z info cache returned workload trust anchor from cache ttl=23h59m59.820407951s 2026-10-31T19:49:53.261174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:50:01.256949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:50:02.185946Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T19:50:02.412219Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T19:50:03.477844Z info Readiness succeeded in 10.53510116s 2026-10-31T19:50:03.477865Z info Readiness succeeded in 10.535128175s 2026-10-31T19:50:03.478178Z info Envoy proxy is ready 2026-10-31T19:50:11.644429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:50:20.914614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:50:23.785280Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T19:50:23.671Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 113 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "cbb1c907-26d1-40a5-9e0e-a77f019617c7" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55446 10.134.0.238:443 10.132.0.17:51332 - v1-catch-all-path 2026-10-31T19:50:37.574076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:50:49.324118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:50:52.626031Z info ads ADS: new connection for node:3 2026-10-31T19:50:52.626185Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T19:50:52.626213Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T19:50:56.208387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:51:35.217619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:51:38.420473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:51:38.420510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:51:38.420524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:51:38.420529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T19:51:38.202Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 217 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "d0d3f7ea-c1b7-4038-8fb4-be9f2ade1215" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.238:36014 10.134.0.238:443 10.132.0.17:60142 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T19:51:59.299387Z info ads ADS: "" 3 terminated with stream closed 2026-10-31T19:51:59.750553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:52:04.564470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:52:18.100615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:55:07.875049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:55:07.875100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:55:07.875120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:55:07.875128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T19:55:07.699Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 175 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "4280cd77-000d-4191-851c-d392419b6e9c" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.238:35628 10.134.0.238:443 10.132.0.17:60294 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T19:55:17.508339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:55:45.599360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:56:10.384424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:56:26.060024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:56:39.393472Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:56:51.376049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:56:56.291640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:57:14.559338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:58:02.995895Z info ads ADS: new connection for node:4 2026-10-31T19:58:03.000769Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T19:58:03.000812Z info cache read certificate from file resource=file-root:system 2026-10-31T19:58:06.989599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:58:08.012488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:59:57.832374Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T19:59:57.854725Z info ads ADS: "" 4 terminated with stream closed 2026-10-31T20:00:00.345605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:00:11.039489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:00:13.893322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:00:13.893358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:00:13.893371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T20:00:13.893376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T20:00:11.656Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 2236 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "96bba87c-536b-442e-a5d9-9ac4b141e37c" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.238:48094 10.134.0.238:443 10.132.0.17:33526 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T20:00:29.587476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:00:34.172880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:00:38.746820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-31T20:00:38.682Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 78 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "9d91a9e3-a5fa-41e0-9fc2-0645653e93b0" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55604 10.134.0.238:443 10.132.0.17:55680 - v1-completions-path 2026-10-31T20:00:41.459329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:00:41.459368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:00:41.459382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T20:00:41.459387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T20:00:41.381Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 77 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "83582ffd-264a-4121-9abe-a56f5ec8e1db" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55612 10.134.0.238:443 10.132.0.17:55684 - v1-catch-all-path 2026-10-31T20:00:55.068895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:01:11.967086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T20:01:21.398Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "c24a3f7c-1f4b-4b9f-9c75-d01aa2d6c40f" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55604 10.134.0.238:443 10.132.0.17:59928 - v1-completions-path 2026-10-31T20:01:42.889608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:01:53.495648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:01:59.809936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T20:02:11.169Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "21b93b57-9257-44a0-8eeb-a31cbfb4fb06" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55612 10.134.0.238:443 10.132.0.17:59240 - v1-completions-path [2026-10-31T20:02:12.241Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "4ddc5839-2f64-4259-9f2f-c2f39d4be8c9" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55612 10.134.0.238:443 10.132.0.17:59248 - v1-completions-path 2026-10-31T20:02:28.487043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:02:32.990025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:02:46.365121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:02:52.818621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:03:07.676249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:03:12.157190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:03:24.175086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:03:38.871115Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:03:45.333002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:04:03.596862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:04:08.931127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T20:04:08.166Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 66 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "2124825f-0072-4923-b6ab-8c438a8fe2b0" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.238:443 10.132.0.17:40794 - v1-completions-path 2026-10-31T20:04:20.191913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:04:32.982537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T20:04:32.924Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "1305f30e-f7e6-442e-8215-814261640bee" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55612 10.134.0.238:443 10.132.0.17:55004 - v1-completions-path 2026-10-31T20:04:46.947829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:04:57.617286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:05:16.798968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:05:22.996388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:07:49.151946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:09:16.633197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:09:34.018336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:09:39.061652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:09:50.776977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:10:08.167719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:10:13.369484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T20:10:19.008Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 70 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "487a0360-3b04-4979-b331-b76341a93dfb" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55612 10.134.0.238:443 10.132.0.17:55710 - v1-completions-path 2026-10-31T20:10:33.399845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:10:44.252519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:10:50.495776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T20:11:04.500Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "88eee73c-3eda-4a80-a87a-875b835bcd15" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55612 10.134.0.238:443 10.132.0.17:40360 - v1-completions-path 2026-10-31T20:11:20.769025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:11:27.103048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:11:33.588366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T20:11:43.117Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "d5a10bb5-8444-44a2-a797-99f859443cfc" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55604 10.134.0.238:443 10.132.0.17:54674 - v1-completions-path [2026-10-31T20:11:47.001Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3541e5f9-dca6-4e02-bf1e-60c555695134" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55612 10.134.0.238:443 10.132.0.17:43480 - v1-completions-path [2026-10-31T20:11:50.664Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3a5f7b42-98ab-44f8-8481-ec6676e75136" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55604 10.134.0.238:443 10.132.0.17:43486 - v1-completions-path 2026-10-31T20:12:05.647358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:12:16.338434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:12:23.124581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:12:29.157277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:12:37.497447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:12:37.497520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:12:37.497546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:12:37.497553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T20:12:37.373Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 123 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "a349f249-894a-4c4f-b9b2-9940874fb8ed" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.133.1.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.238:35236 10.134.0.238:443 10.132.0.17:33156 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T20:12:37.703Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "10d9218f-4e79-4182-b269-b78ce86c7f5e" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.238:55612 10.134.0.238:443 10.132.0.17:33160 - v1-completions-path 2026-10-31T20:12:41.142813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:13:04.732943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:13:15.344350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:13:20.199789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:13:38.502168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:13:45.057894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:14:08.668492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:14:30.919402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:14:50.879483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:15:01.886765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:15:13.013936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:15:23.642856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:15:34.506500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:15:45.428183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:15:56.078142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T20:16:06.762441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8