2026-11-04T01:57:58.222064Z info FLAG: --concurrency="0" 2026-11-04T01:57:58.222122Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:57:58.222126Z info FLAG: --help="false" 2026-11-04T01:57:58.222129Z info FLAG: --log_as_json="false" 2026-11-04T01:57:58.222131Z info FLAG: --log_caller="" 2026-11-04T01:57:58.222133Z info FLAG: --log_output_level="default:info" 2026-11-04T01:57:58.222135Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:57:58.222140Z info FLAG: --log_target="[stdout]" 2026-11-04T01:57:58.222142Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:57:58.222144Z info FLAG: --outlierLogPath="" 2026-11-04T01:57:58.222146Z info FLAG: --profiling="true" 2026-11-04T01:57:58.222148Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:57:58.222151Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:57:58.222153Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:57:58.222155Z info FLAG: --stsPort="0" 2026-11-04T01:57:58.222157Z info FLAG: --templateFile="" 2026-11-04T01:57:58.222159Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:57:58.222161Z info FLAG: --vklog="0" 2026-11-04T01:57:58.222164Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:57:58.222319Z info Proxy role ips=[10.134.0.255] type=router id=maas-default-gateway-openshift-default-fc8c56547-pk2g7.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:57:58.222367Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:57:58.223606Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:57:58.223810Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:57:58.223821Z info JWT policy is third-party-jwt 2026-11-04T01:57:58.223823Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:57:58.225643Z info Starting default Istio SDS Server 2026-11-04T01:57:58.225665Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:57:58.225703Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:57:58.226155Z info Opening status port 15020 2026-11-04T01:57:58.227009Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:57:58.227865Z info sds Starting SDS grpc server 2026-11-04T01:57:58.227887Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:57:58.229069Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:57:58.230285Z info Starting proxy agent 2026-11-04T01:57:58.230323Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:57:58.299229Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:57:58.307041Z info cache generated new workload certificate resourceName=default latency=78.967691ms ttl=23h59m59.692963659s 2026-11-04T01:57:58.307080Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:57:58.307114Z info cache returned workload trust anchor from cache ttl=23h59m59.692885964s 2026-11-04T01:57:58.457188Z info ads ADS: new connection for node:1 2026-11-04T01:57:58.457266Z info cache returned workload certificate from cache ttl=23h59m59.542736198s 2026-11-04T01:57:58.457846Z info ads ADS: new connection for node:2 2026-11-04T01:57:58.457922Z info cache returned workload trust anchor from cache ttl=23h59m59.542079035s 2026-11-04T01:57:58.545111Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:07.249798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:08.190606Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-04T01:58:08.722191Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-04T01:58:09.452955Z info Readiness succeeded in 11.233794172s 2026-11-04T01:58:09.453393Z info Envoy proxy is ready 2026-11-04T01:58:13.805758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:18.007891Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-04T01:58:17.913Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 94 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "7b5bc984-00ae-4f17-a1e1-e6c11bb64417" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:58328 10.134.0.255:443 10.132.0.18:34120 - v1-catch-all-path 2026-11-04T01:58:27.922537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:37.871324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:41.255056Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-04T01:58:41.186Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 68 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "36cb7226-8314-4179-b89a-c948d0efb6fd" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:58328 10.134.0.255:443 10.132.0.18:40350 - v1-catch-all-path 2026-11-04T01:58:55.112694Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:06.602838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:09.668397Z info ads ADS: new connection for node:3 2026-11-04T01:59:09.668617Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T01:59:09.668695Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T01:59:13.809327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:58.444153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:00:02.303Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 343 101 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "10e6b63c-7158-45e8-b671-a480811e78f5" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.178:8000" outbound|54321||e2e-prio-pool-b2b6fa4a-inference-pool-ip-c102c16b.llm.svc.cluster.local 10.134.0.255:41962 10.134.0.255:443 10.132.0.18:33364 - v1-model-routing 2026-11-04T02:00:06.499650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-04T02:00:06.444Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 333 61 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "d791a1d5-ad70-4155-a98c-f154d7de29e6" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.178:8000" outbound|54321||e2e-prio-pool-b2b6fa4a-inference-pool-ip-c102c16b.llm.svc.cluster.local 10.134.0.255:41962 10.134.0.255:443 10.132.0.18:41320 - v1-model-routing 2026-11-04T02:00:23.489620Z info ads ADS: "" 3 terminated with stream closed 2026-11-04T02:00:23.780272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:00:28.958620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:00:28.539Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 82 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "66d46cee-b5c5-444e-9424-c21b25e67ca0" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:36588 10.134.0.255:443 10.132.0.18:57656 - v1-completions-path 2026-11-04T02:00:46.287484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:03:27.816313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:03:58.250511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:04:28.672343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:04:42.950466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:04:58.565811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:05:11.489153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:05:16.896196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:05:20.951Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 81 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "63894d98-eaaa-419c-a65a-d54c282faaba" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:50046 10.134.0.255:443 10.132.0.18:40958 - v1-completions-path 2026-11-04T02:05:36.944425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:06:07.560Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 72 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "4328edff-d7f8-47b5-b7d5-e26b515a901f" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:50980 10.134.0.255:443 10.132.0.18:52986 - v1-completions-path 2026-11-04T02:06:24.991929Z info ads ADS: new connection for node:4 2026-11-04T02:06:24.997672Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T02:06:24.997723Z info cache read certificate from file resource=file-root:system 2026-11-04T02:06:28.804426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:06:30.261945Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:06:40.429280Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"172","StreamId":"3079045615257933970"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=26 [2026-11-04T02:06:40.363Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 66 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "bcee4f33-77d8-4ded-bad1-742adea1422e" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.255:443 10.132.0.18:59620 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-04T02:06:59.720898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:06:59.720932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:06:59.720941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T02:06:59.720946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:06:59.721153Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T02:06:59.519Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1536 202 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "73deca3b-6697-4316-8e35-172a138307fd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.255:45534 10.134.0.255:443 10.132.0.18:39774 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T02:07:25.743558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:07:25.743598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:07:25.743609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T02:07:25.743613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:07:25.743810Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-04T02:07:25.543Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1529 200 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "ff04ee7a-e1f4-4a45-9537-b196252e071e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.255:41364 10.134.0.255:443 10.132.0.18:59220 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T02:07:30.475362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:07:30.475393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:07:30.475402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:07:30.475406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T02:07:30.475569Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T02:07:30.350Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1530 124 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "eaf2c121-1af6-4d97-bf4c-f5bc0f8075ca" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.255:45534 10.134.0.255:443 10.132.0.18:59248 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T02:08:10.477069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:08:10.477100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:08:10.477110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T02:08:10.477114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:08:10.477285Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-04T02:08:10.348Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1534 128 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "1f6941bd-981b-42cb-bbd1-ac9ec83080ed" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.255:41364 10.134.0.255:443 10.132.0.18:42492 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T02:08:13.042834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:08:13.042873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:08:13.042883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T02:08:13.042897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T02:08:13.042901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T02:08:12.927Z] "DELETE /v1/api-keys/f61b4cec-68a3-4f1e-b08d-b00c1b8c18d9 HTTP/1.1" 200 - via_upstream - "-" 0 359 115 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "5b3a7c70-6d18-41ec-8dd8-d231530c7f1d" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.255:36628 10.134.0.255:443 10.132.0.18:43660 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T02:08:27.432535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:08:30.810593Z info ads ADS: "" 4 terminated 2026-11-04T02:08:30.916498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:08:31.214585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:12:01.700108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:12:04.856919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:12:04.856962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:12:04.856983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T02:12:04.856989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-04T02:12:04.742Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 114 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "980d9d76-3369-45d4-a574-689d4f7676ee" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.255:43334 10.134.0.255:443 10.132.0.18:39742 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T02:12:21.046234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:12:26.027916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:12:30.513Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 73 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "876553c3-9392-4448-a13d-0ed4ac90e969" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:35892 10.134.0.255:443 10.132.0.18:55210 - v1-completions-path [2026-11-04T02:12:31.681Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "d07814e3-b410-4b6a-94ce-44349c5e5cc3" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:35892 10.134.0.255:443 10.132.0.18:55218 - v1-completions-path [2026-11-04T02:12:33.030Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "8f09d8c6-8d83-48b7-830e-3fd5078888af" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.255:443 10.132.0.18:57140 - v1-completions-path [2026-11-04T02:12:45.362Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 74 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "e3fce547-5028-4be8-ada3-5b834d389229" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:36588 10.134.0.255:443 10.132.0.18:44270 - v1-completions-path 2026-11-04T02:12:50.744386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:13:03.712527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:13:10.473757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:13:10.473794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:13:10.473809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:13:10.473814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T02:13:10.361Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 112 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "452d7aed-c1fe-4ace-ba52-e5d02eb369ca" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.255:49002 10.134.0.255:443 10.132.0.18:41958 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T02:13:11.101Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 73 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "2195ba27-7262-4947-ba06-3ef442e2b778" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:35892 10.134.0.255:443 10.132.0.18:41972 - v1-completions-path [2026-11-04T02:13:11.468Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "fbf477f6-02c8-4b28-9db3-9fde26eb5052" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:50046 10.134.0.255:443 10.132.0.18:41982 - v1-completions-path [2026-11-04T02:13:15.866Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "86540af0-7f5e-43a3-898d-36e487cfc0ba" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:35892 10.134.0.255:443 10.132.0.18:34622 - v1-completions-path 2026-11-04T02:13:35.056059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:13:46.211592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:13:51.243221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:14:05.102Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 69 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "2a13ccfb-0fcf-482d-bac1-a1e000251034" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:50046 10.134.0.255:443 10.132.0.18:46138 - v1-completions-path [2026-11-04T02:14:05.386Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "a6ca906b-5a6b-44c9-9575-cb51d33440e7" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:50046 10.134.0.255:443 10.132.0.18:46154 - v1-completions-path [2026-11-04T02:14:05.959Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 69 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "c477dffc-3df1-43ed-ba6d-ee71c43b6e1b" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:35892 10.134.0.255:443 10.132.0.18:46160 - v1-completions-path 2026-11-04T02:14:20.928574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:14:25.877286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:14:40.018790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:14:49.647750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:14:59.559482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:15:06.331682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:15:21.742918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:15:34.401814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:15:40.914839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:15:59.505428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:16:05.358557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:16:17.237616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:16:43.065387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:16:53.989150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:17:12.703726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:17:20.832067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:19:50.477737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:19:56.819187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:21:24.001152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:21:41.377654Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:21:45.772221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:21:49.137384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:21:49.137438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:21:49.137459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T02:21:49.137467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-04T02:21:49.010Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 127 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "69eea2a4-cc40-4f16-8598-1f8762c04925" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.255:55056 10.134.0.255:443 10.132.0.18:54108 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T02:21:49.342Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 69 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "c24d0c74-504e-448d-a83c-d13b85d29818" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:36588 10.134.0.255:443 10.132.0.18:54132 - v1-completions-path 2026-11-04T02:21:58.494526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:22:15.585423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:22:22.017243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:22:25.156Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 78 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "8652eec5-888c-4d35-b38c-0ac1f26cb66d" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:50046 10.134.0.255:443 10.132.0.18:43564 - v1-completions-path [2026-11-04T02:22:25.426Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "f54432f9-4486-428e-b95e-291096eb3944" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:50046 10.134.0.255:443 10.132.0.18:43570 - v1-completions-path [2026-11-04T02:22:25.693Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "23076ca8-e58e-4f3b-bbaa-fc7bb8615d75" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:35892 10.134.0.255:443 10.132.0.18:43582 - v1-completions-path 2026-11-04T02:22:41.587823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:22:52.347219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:22:58.483208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:23:25.510331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:23:30.030379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:23:35.873311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:23:51.427574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:23:51.427608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:23:51.427622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:23:51.427627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-04T02:23:51.284Z] "DELETE /v1/api-keys/79ad01f1-099e-40c2-93fe-6f20fae78c21 HTTP/1.1" 200 - via_upstream - "-" 0 363 142 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "7686e34b-51ea-48ee-a9d6-2eabc71ff1da" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.1.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.255:60774 10.134.0.255:443 10.132.0.18:36354 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T02:24:05.132087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:24:15.989942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:24:22.505298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:24:28.305844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:24:33.624301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:24:33.624340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-04T02:24:33.624358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-04T02:24:33.624365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-04T02:24:33.508Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 115 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "fadcff4f-563e-4f37-9c90-1547e988a249" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.1.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.255:60774 10.134.0.255:443 10.132.0.18:48364 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T02:24:37.323003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:24:46.160Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "c14c4c00-172d-442a-972f-5794598872ce" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:35892 10.134.0.255:443 10.132.0.18:39982 - v1-completions-path 2026-11-04T02:25:00.701064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:25:11.383032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:25:16.068342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:25:34.146118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:25:40.016602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:25:58.929079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:26:20.869924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:26:42.287810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:26:57.012597Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-04T02:27:02.079771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:27:12.844114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:27:23.573933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:27:34.396134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:27:45.118046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:27:55.220576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:27:55.220611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:27:55.220626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:27:55.220631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T02:27:55.720476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T02:27:55.096Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 123 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "8ea7a69e-f01e-43c5-9fb0-e82efac19f4b" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.193:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.255:36210 10.134.0.255:443 10.132.0.18:57862 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T02:28:06.997Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 78 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "e68dc596-ff1e-434a-8a67-e01e77f5b4dd" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.255:36588 10.134.0.255:443 10.132.0.18:33640 - v1-completions-path