2026-11-01T06:57:24.990822Z info FLAG: --concurrency="0" 2026-11-01T06:57:24.990845Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T06:57:24.990850Z info FLAG: --help="false" 2026-11-01T06:57:24.990852Z info FLAG: --log_as_json="false" 2026-11-01T06:57:24.990854Z info FLAG: --log_caller="" 2026-11-01T06:57:24.990856Z info FLAG: --log_output_level="default:info" 2026-11-01T06:57:24.990858Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T06:57:24.990863Z info FLAG: --log_target="[stdout]" 2026-11-01T06:57:24.990865Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T06:57:24.990867Z info FLAG: --outlierLogPath="" 2026-11-01T06:57:24.990870Z info FLAG: --profiling="true" 2026-11-01T06:57:24.990871Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T06:57:24.990873Z info FLAG: --proxyLogLevel="warning" 2026-11-01T06:57:24.990875Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T06:57:24.990877Z info FLAG: --stsPort="0" 2026-11-01T06:57:24.990879Z info FLAG: --templateFile="" 2026-11-01T06:57:24.990881Z info FLAG: --tokenManagerPlugin="" 2026-11-01T06:57:24.990884Z info FLAG: --vklog="0" 2026-11-01T06:57:24.990886Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T06:57:24.991023Z info Proxy role ips=[10.132.1.3] type=router id=maas-default-gateway-openshift-default-855f9574cf-jl24d.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T06:57:24.991077Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T06:57:24.992138Z info cpu limit detected as 2, setting concurrency 2026-11-01T06:57:24.992349Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T06:57:24.992360Z info JWT policy is third-party-jwt 2026-11-01T06:57:24.992363Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T06:57:24.994586Z info Starting default Istio SDS Server 2026-11-01T06:57:24.994609Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T06:57:24.994633Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T06:57:24.995135Z info Opening status port 15020 2026-11-01T06:57:24.996050Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T06:57:24.996649Z info sds Starting SDS grpc server 2026-11-01T06:57:24.996669Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T06:57:24.997867Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T06:57:24.998934Z info Starting proxy agent 2026-11-01T06:57:24.998972Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T06:57:25.060853Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T06:57:25.108201Z info cache generated new workload certificate resourceName=default latency=111.376192ms ttl=23h59m59.891804505s 2026-11-01T06:57:25.108238Z info cache Root cert has changed, start rotating root cert 2026-11-01T06:57:25.108271Z info cache returned workload trust anchor from cache ttl=23h59m59.891730269s 2026-11-01T06:57:25.217915Z info ads ADS: new connection for node:1 2026-11-01T06:57:25.217994Z info cache returned workload trust anchor from cache ttl=23h59m59.782007445s 2026-11-01T06:57:25.218106Z info ads ADS: new connection for node:2 2026-11-01T06:57:25.218159Z info cache returned workload certificate from cache ttl=23h59m59.781841877s 2026-11-01T06:57:25.298393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:57:33.112337Z info Readiness succeeded in 8.123795246s 2026-11-01T06:57:33.112777Z info Envoy proxy is ready 2026-11-01T06:59:30.842332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:59:30.842372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:59:30.842386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:59:30.842391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T06:59:30.712Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 129 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "dd9b79c5-cdc5-4628-8bbd-33d83f3c3dc9" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.3:44418 10.132.1.3:443 10.132.0.10:35066 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:59:53.324706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:59:55.548Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 292 100 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "7d967eae-49b3-4462-bba0-c5f9ce49434d" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:59274 10.132.1.3:443 10.132.0.10:37314 - v1-completions-path 2026-11-01T07:00:12.395301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:19.621788Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:40.785927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:48.117826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:10.545502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:21.800399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:41.292607Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:52.417338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:03.470731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:14.209788Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:25.029362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:45.720831Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:56.651375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:03:07.388387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:03:18.161032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:05:45.468869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:05:48.078258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:05:48.078298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:05:48.078313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:05:48.078318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T07:05:47.928Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 304 149 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "a88ef821-63e1-44eb-8c83-b6d3ca4f1dd7" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.3:55246 10.132.1.3:443 10.132.0.10:39640 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T07:05:49.553Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 77 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "5fb624d9-e66d-461e-88b7-e2f2c3c1a257" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:40638 10.132.1.3:443 10.132.0.10:56620 - v1-chat-completions-path 2026-11-01T07:06:04.637320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:09.374966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:18.689217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:24.308765Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T07:06:24.235Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 73 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "4c86049f-c0b1-46c2-9530-cb90766892be" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:59136 10.132.1.3:443 10.132.0.10:39692 - v1-catch-all-path 2026-11-01T07:06:32.067292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:50.305684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:06.936137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:18.755077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:21.925647Z info ads ADS: new connection for node:3 2026-11-01T07:07:21.925771Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T07:07:21.925794Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T07:07:25.437189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:04.570621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:08:10.932Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 341 81 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "b71c82d8-6b8b-4bb3-a973-e61f91784ce9" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.168:8000" outbound|54321||e2e-prio-pool-fade3a71-inference-pool-ip-e6f39fc6.llm.svc.cluster.local 10.132.1.3:44596 10.132.1.3:443 10.132.0.10:47360 - v1-model-routing 2026-11-01T07:08:28.614156Z info ads ADS: "" 3 terminated 2026-11-01T07:08:28.659904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:33.299762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:44.831945Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:09:03.511Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 77 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "69a858c8-8f2e-4a21-944f-00bab5fea0ab" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:42742 10.132.1.3:443 10.132.0.10:41842 - v1-completions-path 2026-11-01T07:09:17.231919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:09:47.582329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:10:15.165577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:10:46.015203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:01.256525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:18.903822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:30.690839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:35.576079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:55.090613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:12:49.231419Z info ads ADS: new connection for node:4 2026-11-01T07:12:49.237522Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T07:12:49.237571Z info cache read certificate from file resource=file-root:system 2026-11-01T07:12:53.044648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:12:54.171648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:12:57.407771Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"278","StreamId":"13147543491569784975"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-11-01T07:12:57.349Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 58 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "4084d8c1-54d6-4023-8dad-fd5a351b76c4" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.1.3:443 10.132.0.10:34524 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-01T07:14:06.748064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-01T07:14:06.864665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:14:06.864698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:14:06.864712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T07:14:06.864718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:14:06.864921Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T07:14:06.740Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 124 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "e96cf3b8-a47c-4f77-8605-60014ed95e79" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.3:56540 10.132.1.3:443 10.132.0.10:57606 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T07:14:46.141324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:14:46.159564Z info ads ADS: "" 4 terminated 2026-11-01T07:14:48.703552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:14:58.884094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:15:03.685852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T07:15:03.626Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 78 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "21f102c9-af02-4775-98da-2c864d4c064b" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:48598 10.132.1.3:443 10.132.0.10:44692 - v1-completions-path 2026-11-01T07:15:31.036594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:15:54.275415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:16:09.056Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "43ff42fb-42f0-44f8-a2a0-d69e4f47e8ca" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:48598 10.132.1.3:443 10.132.0.10:48892 - v1-completions-path 2026-11-01T07:16:28.757827Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:39.502705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:54.600447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:17:00.990Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "e531ec72-7619-4f24-95ce-981c5a00b21e" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:41408 - v1-completions-path 2026-11-01T07:17:18.045865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:17:30.185036Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:17:39.404123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:17:52.436998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:01.784326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:10.862366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:20.120414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:36.889345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:48.146406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:28.094235Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:42.349945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:19:42.349982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:19:42.349998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:19:42.350003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T07:19:42.236Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 113 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "24b4af71-2075-4b71-b4ec-1ebbea4f2800" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.3:57666 10.132.1.3:443 10.132.0.10:55484 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T07:19:42.828Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 57 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "f26e6d7d-9cf5-47a9-81a5-8116a454100c" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:55492 - v1-completions-path 2026-11-01T07:19:56.581313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:20:07.470393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:04.780197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:09.568124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:17.951089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:27.342435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:57.755308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:02.696995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:25:07.463Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "2f57b08b-f97f-48a2-aaec-e9e13c43ec6a" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:55506 - v1-completions-path 2026-11-01T07:25:22.418014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:33.207158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:39.604080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:51.990678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:25:51.990713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:25:51.990728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T07:25:51.990734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T07:25:51.872Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 118 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "edd66189-7955-44b2-a4f5-fa09a2fa54c6" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.177:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.3:47484 10.132.1.3:443 10.132.0.10:60440 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T07:25:52.201Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "9886b571-8cbf-47ef-8eb5-22db79af8866" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:60450 - v1-completions-path [2026-11-01T07:25:53.076Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "31fea35e-b760-4f71-9038-1d2628af6430" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:60470 - v1-completions-path 2026-11-01T07:25:55.066349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:25:55.066386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T07:25:55.066402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T07:25:55.066407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T07:25:54.956Z] "DELETE /v1/api-keys/b0bfe1ee-e08a-403f-ad57-8ec63e770600 HTTP/1.1" 200 - via_upstream - "-" 0 365 110 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "29d61468-0baa-48c5-be2f-560ab6d46f0a" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.177:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.3:47484 10.132.1.3:443 10.132.0.10:60484 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:26:08.575874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:14.846762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:20.876352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:26:29.976Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 61 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "f4e4280d-0480-49d2-a853-832e87540ade" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:49386 - v1-completions-path [2026-11-01T07:26:30.341Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "51d8acfc-aa71-45d8-8752-d10d51c54398" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:48598 10.132.1.3:443 10.132.0.10:49394 - v1-completions-path [2026-11-01T07:26:31.404Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "b4a63def-9345-4134-9a38-4c779c6fe9f4" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:49404 - v1-completions-path [2026-11-01T07:26:32.871Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "3f8a51b6-4806-45d5-9d37-14b120e9e504" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:48598 10.132.1.3:443 10.132.0.10:49414 - v1-completions-path [2026-11-01T07:26:34.286Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "f19c96e4-fd6b-4547-8c1a-dc1a4247c100" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:49444 - v1-completions-path 2026-11-01T07:26:45.982955Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T07:26:49.959175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:10.684268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:17.259287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:23.383454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:32.817445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:27:38.623Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 68 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "81849081-0e13-4776-92a7-777307eb8e78" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.3:46176 10.132.1.3:443 10.132.0.10:49612 - v1-completions-path 2026-11-01T07:27:55.620174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:28:06.317379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8