2026-11-03T02:49:47.687203Z info FLAG: --concurrency="0" 2026-11-03T02:49:47.687229Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T02:49:47.687234Z info FLAG: --help="false" 2026-11-03T02:49:47.687238Z info FLAG: --log_as_json="false" 2026-11-03T02:49:47.687240Z info FLAG: --log_caller="" 2026-11-03T02:49:47.687243Z info FLAG: --log_output_level="default:info" 2026-11-03T02:49:47.687246Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T02:49:47.687253Z info FLAG: --log_target="[stdout]" 2026-11-03T02:49:47.687256Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T02:49:47.687259Z info FLAG: --outlierLogPath="" 2026-11-03T02:49:47.687262Z info FLAG: --profiling="true" 2026-11-03T02:49:47.687265Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T02:49:47.687268Z info FLAG: --proxyLogLevel="warning" 2026-11-03T02:49:47.687271Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T02:49:47.687274Z info FLAG: --stsPort="0" 2026-11-03T02:49:47.687277Z info FLAG: --templateFile="" 2026-11-03T02:49:47.687280Z info FLAG: --tokenManagerPlugin="" 2026-11-03T02:49:47.687284Z info FLAG: --vklog="0" 2026-11-03T02:49:47.687288Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T02:49:47.687493Z info Proxy role ips=[10.133.1.127] type=router id=maas-default-gateway-openshift-default-59f957fdd7-xzjj9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T02:49:47.687553Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T02:49:47.689216Z info cpu limit detected as 2, setting concurrency 2026-11-03T02:49:47.689601Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T02:49:47.689617Z info JWT policy is third-party-jwt 2026-11-03T02:49:47.689621Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T02:49:47.691546Z info Starting default Istio SDS Server 2026-11-03T02:49:47.691579Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T02:49:47.691604Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T02:49:47.691951Z info Opening status port 15020 2026-11-03T02:49:47.692829Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T02:49:47.693399Z info sds Starting SDS grpc server 2026-11-03T02:49:47.693415Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T02:49:47.694611Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T02:49:47.695724Z info Starting proxy agent 2026-11-03T02:49:47.695767Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T02:49:47.769946Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T02:49:47.794649Z info cache generated new workload certificate resourceName=default latency=101.144264ms ttl=23h59m59.20535733s 2026-11-03T02:49:47.794691Z info cache Root cert has changed, start rotating root cert 2026-11-03T02:49:47.794745Z info cache returned workload trust anchor from cache ttl=23h59m59.205256318s 2026-11-03T02:49:47.913971Z info ads ADS: new connection for node:1 2026-11-03T02:49:47.914183Z info cache returned workload certificate from cache ttl=23h59m59.085819938s 2026-11-03T02:49:47.914611Z info ads ADS: new connection for node:2 2026-11-03T02:49:47.914866Z info cache returned workload trust anchor from cache ttl=23h59m59.085137067s 2026-11-03T02:49:48.005815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:49:55.897792Z info Readiness succeeded in 8.213887307s 2026-11-03T02:49:55.898151Z info Envoy proxy is ready 2026-11-03T02:49:57.623719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:50:06.765867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:50:16.526156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:50:35.844103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:50:39.033526Z info ads ADS: new connection for node:3 2026-11-03T02:50:39.033773Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T02:50:39.033818Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T02:50:42.993710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:51:22.221739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:51:46.515425Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T02:51:46.790218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:51:53.529144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:52:08.662223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:54:43.425331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:55:10.390473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:55:32.821178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:55:48.164151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:55:56.860547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:56:10.382771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:56:15.264941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:56:33.911763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:57:22.784622Z info ads ADS: new connection for node:4 2026-11-03T02:57:22.789060Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T02:57:22.789102Z info cache read certificate from file resource=file-root:system 2026-11-03T02:57:26.543955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:57:27.866010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:57:49.743803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:49.743835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:49.743847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:49.743851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T02:57:49.744035Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T02:57:49.542Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 201 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "b166e17e-b1e4-4d53-a678-224681c5e262" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.127:58646 10.133.1.127:443 10.132.0.19:46158 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:57:52.081885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:52.081915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:52.081924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:57:52.081928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T02:57:52.082065Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T02:57:51.953Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 128 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "657daa05-ffd6-4a39-89a1-b530693cf3c4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.127:58646 10.133.1.127:443 10.132.0.19:52034 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:58:08.709495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:58:08.709523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:58:08.709532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T02:58:08.709536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:58:08.709671Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T02:58:08.579Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1724 130 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "d9993dbc-00f7-4ba9-b783-e5fc0e103251" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.127:58646 10.133.1.127:443 10.132.0.19:38178 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:58:13.324645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T02:58:13.439467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:58:13.439497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:58:13.439507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T02:58:13.439511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:58:13.439664Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T02:58:13.318Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 120 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "97de47ea-944d-4dfe-b288-c038f4d7d99b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.127:58646 10.133.1.127:443 10.132.0.19:35428 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:58:22.985632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T02:58:22.985670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T02:58:22.985681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T02:58:22.985685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T02:58:22.985878Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T02:58:22.784Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 201 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "0a1ab29e-85cf-420e-be5e-8c9d7110b5d2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.127:50038 10.133.1.127:443 10.132.0.19:41920 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T02:59:02.563886Z info ads ADS: "" 4 terminated 2026-11-03T02:59:02.617107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:05.327174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:15.979045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:34.548285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:59:39.313147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T02:59:43.918Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 73 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f8f09783-1659-42f1-a93f-e97220f45d49" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.127:38622 10.133.1.127:443 10.132.0.19:51976 - v1-completions-path 2026-11-03T02:59:58.671923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:00:16.143379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:00:46.795998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:00:57.496955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:03.900629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:14.825526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:01:14.825561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:01:14.825576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:01:14.825581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T03:01:14.712Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 113 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "541e9c08-eea5-4c0d-a539-f03209ce17c1" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.127:37398 10.133.1.127:443 10.132.0.19:54314 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T03:01:18.302Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "7098add7-389f-40cf-bc7a-6cd7024ac5f0" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.127:57242 10.133.1.127:443 10.132.0.19:54322 - v1-completions-path 2026-11-03T03:01:32.888232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:37.444292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:49.235326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:01:58.035685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:02:07.584514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:02:16.487779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:02:24.423107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:02:43.282108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:02:46.441Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 79 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "d871b323-94b3-9ecb-b5e8-cf85f0ef50a6" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.127:35558 10.133.1.127:443 10.132.0.19:56360 - v1-completions-path 2026-11-03T03:03:14.947940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:03:38.292887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:03:48.974453Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:08:15.994631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:08:33.414155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:08:37.873590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:08:50.971862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:08.622220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:16.491261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:36.990774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:47.760518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:09:54.016976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:10:22.038825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:10:28.345567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:10:34.330149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:10:42.516Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 66 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "24974249-e873-473e-b285-64f65d94fe86" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.127:38622 10.133.1.127:443 10.132.0.19:34136 - v1-completions-path [2026-11-03T03:10:43.268Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "49677468-8108-4d15-8673-d56ba7fcde6f" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.127:57242 10.133.1.127:443 10.132.0.19:34140 - v1-completions-path 2026-11-03T03:11:05.304118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:11:15.957174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:11:22.563972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:11:28.514373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:11:39.282526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:11:45.960Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "34440b08-98c9-45f4-81c7-6c8097f5ed0e" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.127:38622 10.133.1.127:443 10.132.0.19:58916 - v1-completions-path 2026-11-03T03:12:02.918217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:12:13.736010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:12:18.670336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:12:37.031754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:12:44.109951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:13:04.787181Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:13:26.764489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:13:46.769167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:13:57.710687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:08.382165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:19.171713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:30.107272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:40.919847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:14:51.648658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:15:02.371253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:15:08.719466Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:15:08.719496Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:15:08.719500Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:15:08.719505Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T03:15:08.697Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 22 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "a96e2a21-dfe2-4e82-973e-a527ccb5c402" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.127:443 10.132.0.19:37464 - v1-completions-path [2026-11-03T03:15:18.158Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 72 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "5c404a08-c255-4b8d-bd25-baaf2a0c568d" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.127:35558 10.133.1.127:443 10.132.0.19:57858 - v1-completions-path 2026-11-03T03:15:19.001924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T03:15:18.915Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 98 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "0f820cde-8cd0-47dc-8cfc-1d56b9b10225" "maas.apps.a6ff95811a9faa36af00.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.127:49452 10.133.1.127:443 10.132.0.19:57872 - v1-completions-path