2026-11-02T14:48:11.223341Z info FLAG: --concurrency="0" 2026-11-02T14:48:11.223362Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T14:48:11.223366Z info FLAG: --help="false" 2026-11-02T14:48:11.223369Z info FLAG: --log_as_json="false" 2026-11-02T14:48:11.223372Z info FLAG: --log_caller="" 2026-11-02T14:48:11.223374Z info FLAG: --log_output_level="default:info" 2026-11-02T14:48:11.223376Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T14:48:11.223381Z info FLAG: --log_target="[stdout]" 2026-11-02T14:48:11.223384Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T14:48:11.223386Z info FLAG: --outlierLogPath="" 2026-11-02T14:48:11.223388Z info FLAG: --profiling="true" 2026-11-02T14:48:11.223397Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T14:48:11.223400Z info FLAG: --proxyLogLevel="warning" 2026-11-02T14:48:11.223402Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T14:48:11.223405Z info FLAG: --stsPort="0" 2026-11-02T14:48:11.223406Z info FLAG: --templateFile="" 2026-11-02T14:48:11.223408Z info FLAG: --tokenManagerPlugin="" 2026-11-02T14:48:11.223411Z info FLAG: --vklog="0" 2026-11-02T14:48:11.223414Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T14:48:11.223568Z info Proxy role ips=[10.133.1.37] type=router id=maas-default-gateway-openshift-default-6886b96f9-xqg2g.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T14:48:11.223619Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T14:48:11.224632Z info cpu limit detected as 2, setting concurrency 2026-11-02T14:48:11.224941Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T14:48:11.224953Z info JWT policy is third-party-jwt 2026-11-02T14:48:11.224957Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T14:48:11.226425Z info Starting default Istio SDS Server 2026-11-02T14:48:11.226447Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T14:48:11.226466Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T14:48:11.227106Z info Opening status port 15020 2026-11-02T14:48:11.227912Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T14:48:11.229436Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T14:48:11.230325Z info Starting proxy agent 2026-11-02T14:48:11.230363Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T14:48:11.239397Z info sds Starting SDS grpc server 2026-11-02T14:48:11.239418Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T14:48:11.319911Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T14:48:11.343925Z info cache generated new workload certificate resourceName=default latency=116.36216ms ttl=23h59m59.656078456s 2026-11-02T14:48:11.343963Z info cache Root cert has changed, start rotating root cert 2026-11-02T14:48:11.344016Z info cache returned workload trust anchor from cache ttl=23h59m59.655984555s 2026-11-02T14:48:11.666903Z info ads ADS: new connection for node:1 2026-11-02T14:48:11.667085Z info cache returned workload certificate from cache ttl=23h59m59.33291736s 2026-11-02T14:48:11.667303Z info ads ADS: new connection for node:2 2026-11-02T14:48:11.667413Z info cache returned workload trust anchor from cache ttl=23h59m59.332589399s 2026-11-02T14:48:11.772491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:48:19.793121Z info Readiness succeeded in 8.571958228s 2026-11-02T14:48:19.793411Z info Envoy proxy is ready 2026-11-02T14:49:37.232509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:50:09.702496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:51:35.514391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:51:38.206501Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T15:00:01.881627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:00:24.048249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:00:56.544812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:00:59.574253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:00:59.574298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:00:59.574313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:00:59.574318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:00:58.970Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 303 603 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0d9b625e-a82d-455c-9d8a-6ae85870b06a" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.37:60012 10.133.1.37:443 10.132.0.19:36488 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:00:59.846Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 127 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d6763702-fccc-4534-a54e-0df79471d542" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:42864 10.133.1.37:443 10.132.0.19:36508 - v1-chat-completions-path [2026-11-02T15:01:00.067Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 74 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "f897e87d-1e57-402c-bf34-984d1ef153a1" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:42880 10.133.1.37:443 10.132.0.19:36512 - v1-chat-completions-path [2026-11-02T15:01:00.500Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 68 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4b193a78-3f02-4024-8773-6f8d968cecca" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:42864 10.133.1.37:443 10.132.0.19:36526 - v1-chat-completions-path 2026-11-02T15:01:12.590705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:15.902567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:22.331954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:25.420966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:01:25.421052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:01:25.421068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:01:25.421073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 [2026-11-02T15:01:24.975Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 445 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0a60fab5-aaeb-4af1-9273-5881ba1ff435" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.37:35908 10.133.1.37:443 10.132.0.19:34164 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:01:29.742498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:39.539433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:01:54.511262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:05.492887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:07.280960Z info ads ADS: new connection for node:3 2026-11-02T15:02:07.281333Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T15:02:07.281404Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T15:02:08.075190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:02:49.839747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:03:08.989875Z info ads ADS: "" 3 terminated 2026-11-02T15:03:09.036327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:03:12.454542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:03:20.906596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:05:52.909687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:09.181922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:25.004344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:36.874597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:06:40.640109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:06:40.640143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:06:40.640155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:06:40.640160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:06:41.250041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:06:40.580Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 59 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "5213b0e5-efce-433d-b0ff-aeacae30df29" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.37:49776 10.133.1.37:443 10.132.0.19:38228 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:06:52.533484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:07:05.933078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:07:09.184Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "3db2f973-876f-46a2-9741-70c5cb5e2fc7" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.37:443 10.132.0.19:59484 - v1-completions-path 2026-11-02T15:07:21.316093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:08:17.469788Z info ads ADS: new connection for node:4 2026-11-02T15:08:17.475045Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T15:08:17.475104Z info cache read certificate from file resource=file-root:system 2026-11-02T15:08:18.524844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:08:20.101160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:08:25.376311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=27 2026-11-02T15:08:25.377453Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"344","StreamId":"17880714646008107994"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=27 [2026-11-02T15:08:25.317Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b3ee34f8-9eec-4390-a7f0-d9be1f0efabd" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.1.37:443 10.132.0.19:49682 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-02T15:08:40.231769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:40.231806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:40.231817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:40.231822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:08:40.231967Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:08:40.125Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1707 106 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "2b1b7e59-9b46-486f-9ad4-d5c5f4f72cf1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.37:43214 10.133.1.37:443 10.132.0.19:49728 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:08:59.364273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T15:08:59.402572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:59.402609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:59.402625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:08:59.402631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:08:59.402805Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:08:59.304Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 98 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "dc28085b-63db-4b5a-9f60-5f259bd3b783" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.37:43214 10.133.1.37:443 10.132.0.19:37674 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:05.801447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:09:05.801486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:09:05.801499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 2026-11-02T15:09:05.801504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:09:05.801667Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=27 [2026-11-02T15:09:05.692Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1707 109 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "c9b2bc4a-da6d-407e-bb82-245d672ba451" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.37:39196 10.133.1.37:443 10.132.0.19:37698 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:16.497389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:16.497423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:16.497434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:09:16.497439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:16.497592Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:09:16.399Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1711 98 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "eea92d36-8a82-436c-b85f-c81eb7f703af" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.37:43214 10.133.1.37:443 10.132.0.19:48242 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:27.118768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:27.118815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:27.118830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:27.118837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:09:27.119077Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:09:27.019Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1711 99 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "221e7c6c-2109-432a-858d-9489cd26a056" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.37:43214 10.133.1.37:443 10.132.0.19:53452 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:35.593919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:09:35.593956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:09:35.593969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 2026-11-02T15:09:35.593974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:09:35.594172Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=27 [2026-11-02T15:09:35.497Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1704 96 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "756783f1-9940-40f5-bb24-76b074ba9fb8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.37:39196 10.133.1.37:443 10.132.0.19:59648 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:09:37.709278Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:37.709320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:37.709336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:09:37.709342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:09:37.709522Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:09:37.616Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1706 93 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "15393dc6-e573-406f-a735-9f505704dff0" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.37:43214 10.133.1.37:443 10.132.0.19:42624 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:10:07.515379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:07.624756Z info ads ADS: "" 4 terminated with stream closed 2026-11-02T15:10:07.907322Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=27 2026-11-02T15:10:07.907349Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=27 2026-11-02T15:10:07.907353Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=27 2026-11-02T15:10:07.907357Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=27 [2026-11-02T15:10:07.871Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 36 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "f2198961-88d4-4b93-ae27-1eca5682bbd4" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.37:443 10.132.0.19:48312 - v1-completions-path 2026-11-02T15:10:09.001420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:14.329914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:10:17.350Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 75 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0c8bb42c-211a-4b41-b000-ae770ca7e225" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:38164 10.133.1.37:443 10.132.0.19:50054 - v1-completions-path 2026-11-02T15:10:30.349072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:10:34.992054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:10:38.103Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b99b0302-9b2f-4084-abac-37ad515ef3e4" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.37:443 10.132.0.19:60506 - v1-completions-path 2026-11-02T15:10:50.252307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:11:05.923920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:11:11.269Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "cbb6c609-ce7a-4a18-bd9e-b4460a8a91d0" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:38164 10.133.1.37:443 10.132.0.19:56396 - v1-completions-path [2026-11-02T15:11:12.064Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "a272f265-da44-47ad-a6a6-e4f4f25a0ce3" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:60402 10.133.1.37:443 10.132.0.19:56404 - v1-completions-path [2026-11-02T15:11:12.147Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "296f82ec-431e-44d1-8142-f264eadac298" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:60402 10.133.1.37:443 10.132.0.19:56410 - v1-completions-path [2026-11-02T15:11:12.799Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "61140261-e171-484f-8ffd-8ddfc05a79ca" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:38164 10.133.1.37:443 10.132.0.19:56426 - v1-completions-path 2026-11-02T15:11:29.121001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:11:39.375817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:11:44.080911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:11:51.392Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "ba97aff3-2b7a-4866-b79c-a64a7b23d182" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:38164 10.133.1.37:443 10.132.0.19:51504 - v1-completions-path 2026-11-02T15:12:03.899705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:06.296280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:13.958391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:23.487877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:29.078675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:37.135959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:42.688859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:12:48.536Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 73 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "930a0a66-9e91-4348-a377-3acda503cd57" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:40112 10.133.1.37:443 10.132.0.19:57964 - v1-completions-path 2026-11-02T15:13:00.626979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:03.889947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:19.673798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:22.704411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:30.814756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:35.953503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:13:35.953543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 2026-11-02T15:13:35.953559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=27 2026-11-02T15:13:35.953563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=27 [2026-11-02T15:13:35.878Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 75 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0c2b0393-9ad4-4932-b2f0-8dbc63bb26ca" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.134.0.41:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.37:44802 10.133.1.37:443 10.132.0.19:44520 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:13:35.989Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b0c74ea0-0894-4dae-8551-d6b4a1c2a076" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:38164 10.133.1.37:443 10.132.0.19:44530 - v1-completions-path 2026-11-02T15:13:48.311836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:58.578437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:14:04.507199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:14:12.464277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:16:57.770535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:17:00.600609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:18:26.865612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:18:27.176Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 429 - - "-" 73 18 112 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b7eb8a82-3812-47ba-97c8-64479703f7ce" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.37:443 10.132.0.19:34424 - v1-completions-path 2026-11-02T15:18:44.457239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:18:46.823822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:18:54.258618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:21.033079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:24.257812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:19:24.895Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 116 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "7340aff8-19b9-4fc6-a690-e488e8939801" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:60402 10.133.1.37:443 10.132.0.19:52370 - v1-completions-path [2026-11-02T15:19:27.603Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e346715d-d907-4e4f-ba60-8f8e88459977" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:38164 10.133.1.37:443 10.132.0.19:47272 - v1-completions-path 2026-11-02T15:19:39.952418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:50.197176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:19:54.803467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:19:58.778Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "af7fffca-3897-4c4f-b24d-5262f40f0560" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:38164 10.133.1.37:443 10.132.0.19:46164 - v1-completions-path 2026-11-02T15:19:59.744408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:59.744445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:59.744460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:19:59.744466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:19:59.324Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "681365f4-b61b-4dfd-a0b6-69658c60c892" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:60402 10.133.1.37:443 10.132.0.19:46174 - v1-completions-path [2026-11-02T15:19:59.671Z] "DELETE /v1/api-keys/ad8b2fbb-1ddd-47a2-9aa7-0865e9106987 HTTP/1.1" 200 - via_upstream - "-" 0 365 73 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b9c8f58a-9d39-4c9b-ba35-2c44bd53336b" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.1.97:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.37:58640 10.133.1.37:443 10.132.0.19:46186 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:20:11.784841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:16.252030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:20.196172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:20:29.656Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8e486645-c8c4-41dd-8296-7d6a82129ff2" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:60402 10.133.1.37:443 10.132.0.19:41778 - v1-completions-path 2026-11-02T15:20:42.560269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:52.734853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:57.404772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:01.190961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:06.283956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:21:11.609Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b33cce02-54e2-49a9-a93b-5e4b38caecec" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:38164 10.133.1.37:443 10.132.0.19:42458 - v1-completions-path [2026-11-02T15:21:11.970Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "daf64f94-724b-4a06-a697-d81d205c750e" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.133.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:60402 10.133.1.37:443 10.132.0.19:42472 - v1-completions-path 2026-11-02T15:21:24.460896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:34.706488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:36.992965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:49.478589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:52.799869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:10.853944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:13.223857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:31.579087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:41.887938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:22:52.211952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:02.505545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:12.876459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:23.061178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:33.413690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:43.781818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:54.078701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:24:04.363629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:24:08.518345Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T15:24:13.880657Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:24:13.880687Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:24:13.880690Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:24:13.880694Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T15:24:13.542Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 79 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "a0412c60-c850-4628-82fa-087587075269" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:40112 10.133.1.37:443 10.132.0.19:53532 - v1-completions-path [2026-11-02T15:24:13.856Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 24 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "50ea9605-3969-4da8-a9ae-12e5f1ae1275" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.37:443 10.132.0.19:53540 - v1-completions-path [2026-11-02T15:24:13.900Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 61 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "488e4014-5321-4d9d-836c-aedd61b6ae06" "maas.apps.59ad8915e5dac481f8f4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.37:40112 10.133.1.37:443 10.132.0.19:53544 - v1-completions-path