2026-11-03T17:27:34.746060Z info FLAG: --concurrency="0" 2026-11-03T17:27:34.746079Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T17:27:34.746083Z info FLAG: --help="false" 2026-11-03T17:27:34.746085Z info FLAG: --log_as_json="false" 2026-11-03T17:27:34.746087Z info FLAG: --log_caller="" 2026-11-03T17:27:34.746089Z info FLAG: --log_output_level="default:info" 2026-11-03T17:27:34.746091Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T17:27:34.746095Z info FLAG: --log_target="[stdout]" 2026-11-03T17:27:34.746098Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T17:27:34.746100Z info FLAG: --outlierLogPath="" 2026-11-03T17:27:34.746102Z info FLAG: --profiling="true" 2026-11-03T17:27:34.746104Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T17:27:34.746105Z info FLAG: --proxyLogLevel="warning" 2026-11-03T17:27:34.746107Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T17:27:34.746109Z info FLAG: --stsPort="0" 2026-11-03T17:27:34.746111Z info FLAG: --templateFile="" 2026-11-03T17:27:34.746113Z info FLAG: --tokenManagerPlugin="" 2026-11-03T17:27:34.746115Z info FLAG: --vklog="0" 2026-11-03T17:27:34.746118Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T17:27:34.746267Z info Proxy role ips=[10.132.1.13] type=router id=maas-default-gateway-openshift-default-c9ffffc7f-9gxvm.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T17:27:34.746311Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T17:27:34.747639Z info cpu limit detected as 2, setting concurrency 2026-11-03T17:27:34.747844Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T17:27:34.747855Z info JWT policy is third-party-jwt 2026-11-03T17:27:34.747858Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T17:27:34.749347Z info Starting default Istio SDS Server 2026-11-03T17:27:34.749369Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T17:27:34.749388Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T17:27:34.749677Z info Opening status port 15020 2026-11-03T17:27:34.750583Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T17:27:34.751011Z info sds Starting SDS grpc server 2026-11-03T17:27:34.751044Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T17:27:34.751906Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T17:27:34.752775Z info Starting proxy agent 2026-11-03T17:27:34.752813Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T17:27:34.815744Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T17:27:34.819166Z info cache generated new workload certificate resourceName=default latency=68.046203ms ttl=23h59m59.180837405s 2026-11-03T17:27:34.819201Z info cache Root cert has changed, start rotating root cert 2026-11-03T17:27:34.819247Z info cache returned workload trust anchor from cache ttl=23h59m59.180753612s 2026-11-03T17:27:35.050639Z info ads ADS: new connection for node:1 2026-11-03T17:27:35.050657Z info ads ADS: new connection for node:2 2026-11-03T17:27:35.050741Z info cache returned workload certificate from cache ttl=23h59m58.949261319s 2026-11-03T17:27:35.050777Z info cache returned workload trust anchor from cache ttl=23h59m58.949225696s 2026-11-03T17:27:35.157508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:27:43.377180Z info Readiness succeeded in 8.63338202s 2026-11-03T17:27:43.377583Z info Envoy proxy is ready 2026-11-03T17:27:44.730038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:28:14.584570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:29:53.870721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:38:56.325337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T17:38:56.325385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T17:38:56.325405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T17:38:56.325411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T17:38:56.207Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 118 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "35cd2849-bf1d-4b6a-aa6d-18b00a79b4ce" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.13:42496 10.132.1.13:443 10.132.0.10:55584 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:39:00.979617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:39:24.633220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:39:58.105433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:40:01.576Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 186 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f3010e2a-f95c-4fcb-a397-bc5b45f91ffa" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.13:42966 10.132.1.13:443 10.132.0.10:34970 - v1-chat-completions-path 2026-11-03T17:40:13.298837Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T17:40:13.298870Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T17:40:13.298873Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T17:40:13.298877Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T17:40:13.221Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 77 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "298cafe9-a5fb-4755-bf44-9a01fdfcc7f3" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.13:443 10.132.0.10:47374 - v1-catch-all-path 2026-11-03T17:40:14.015608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:16.573286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:19.327817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:40:19.327852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:40:19.327866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:40:19.327871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T17:40:19.225Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 102 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "48350477-59a7-41cf-aa29-833f66a9b350" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.13:51948 10.132.1.13:443 10.132.0.10:47402 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:40:23.003708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:30.291164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:39.994868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:40:54.736035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:41:05.808670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:41:07.686979Z info ads ADS: new connection for node:3 2026-11-03T17:41:07.687351Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T17:41:07.687459Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T17:41:09.760318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:41:50.200075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:41:51.038Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 357 2115 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "1a254da4-fdd7-4a7f-981d-d9780974d129" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.133.0.210:8000" outbound|54321||e2e-prio-pool-39e7fadb-inference-pool-ip-afbec136.llm.svc.cluster.local 10.132.1.13:57200 10.132.1.13:443 10.132.0.10:36348 - v1-model-routing 2026-11-03T17:41:56.557318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-03T17:41:56.494Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 347 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "19c94cab-aa21-4746-b8a2-8cd73bfe6dba" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.133.0.210:8000" outbound|54321||e2e-prio-pool-39e7fadb-inference-pool-ip-afbec136.llm.svc.cluster.local 10.132.1.13:57200 10.132.1.13:443 10.132.0.10:38870 - v1-model-routing 2026-11-03T17:42:09.212022Z info ads ADS: "" 3 terminated 2026-11-03T17:42:09.262312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:42:12.661765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:42:19.801513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:44:34.336242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:44:52.382459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:06.090185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:45:06.090227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:45:06.090245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:45:06.090250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T17:45:06.032Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 57 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "15522553-90c3-43ab-ae1c-d3fd3b4eca45" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.13:45798 10.132.1.13:443 10.132.0.10:39698 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:45:08.380160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:19.305869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:26.751396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:38.606961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:42.237023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:45:45.798460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:45:45.798499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:45:45.798514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:45:45.798519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T17:45:45.469Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 72 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "ecb70dcb-6830-438e-869b-37247e7c2851" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.13:42218 10.132.1.13:443 10.132.0.10:52158 - v1-completions-path [2026-11-03T17:45:45.746Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 51 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "cde32c43-7669-4740-9804-3b435d808b2d" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.13:45798 10.132.1.13:443 10.132.0.10:52166 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:45:57.870376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:46:44.409162Z info ads ADS: new connection for node:4 2026-11-03T17:46:44.414416Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T17:46:44.414466Z info cache read certificate from file resource=file-root:system 2026-11-03T17:46:45.497878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:46:47.028394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:47:19.826161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T17:47:19.826200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T17:47:19.826217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T17:47:19.826223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T17:47:19.826465Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T17:47:19.710Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1703 116 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "16400718-9b51-4945-bf84-5fa196be4545" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.13:46254 10.132.1.13:443 10.132.0.10:49034 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T17:47:21.940456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T17:47:21.940492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T17:47:21.940504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T17:47:21.940508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T17:47:21.940656Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T17:47:21.848Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1708 92 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "a42947d0-8c98-4d61-8a35-99d0a679e64e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.13:46254 10.132.1.13:443 10.132.0.10:49042 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T17:47:46.191053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T17:47:46.242107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:46.242141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:46.242153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:46.242157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:47:46.242320Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T17:47:46.131Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 111 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "699f1506-4dfc-4983-9773-3a815f301c66" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.13:60964 10.132.1.13:443 10.132.0.10:41782 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T17:47:48.357618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:48.357656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:48.357672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:48.357678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:47:48.357866Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T17:47:48.265Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1709 92 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "75014cfd-58c8-456f-9202-a4c3cade4108" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.13:60964 10.132.1.13:443 10.132.0.10:41794 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T17:47:52.608176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:52.608208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:52.608221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:47:52.608225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:47:52.608379Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T17:47:52.511Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 97 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "15dff041-fccb-4c72-82ea-ad23d924c9d6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.13:60964 10.132.1.13:443 10.132.0.10:41808 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T17:48:25.194200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:48:25.313814Z info ads ADS: "" 4 terminated 2026-11-03T17:48:26.804143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:48:28.817157Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T17:48:28.817184Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T17:48:28.817188Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T17:48:28.817192Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T17:48:28.780Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 37 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e2cf226b-6b79-48d7-a3ed-1817f6d49af5" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.13:443 10.132.0.10:58988 - v1-completions-path 2026-11-03T17:48:33.790633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:48:49.730487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:48:54.345784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:09.513918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:11.957073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:14.976905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:25.051032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:49:31.038Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "63c9f492-9204-471a-8a21-6adda8448813" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.13:443 10.132.0.10:33794 - v1-completions-path [2026-11-03T17:49:32.024Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b4f0ba71-1fa9-46d9-b463-88b8cb81c854" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.13:42218 10.132.1.13:443 10.132.0.10:33810 - v1-completions-path 2026-11-03T17:49:48.198877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:49:58.551625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:03.117481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:19.940799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:22.270198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:29.361881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:41.319676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:46.386488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:54.777952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:50:59.920185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:51:18.316945Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:51:21.303776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:51:37.120277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:51:40.085232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:51:49.073583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:52:06.808059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:52:17.120637Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:52:34.654421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:52:38.051616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:54:57.156201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:55:00.618237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:56:25.535982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:56:41.029058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:56:43.379424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:56:50.695944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:07.545261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:10.572920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:57:10.818Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 93 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "adbaf12d-74eb-4baf-85a8-a3c7f3563ada" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.13:42218 10.132.1.13:443 10.132.0.10:51648 - v1-completions-path 2026-11-03T17:57:26.038227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:37.167644Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:41.820742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:57:44.622330Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T17:57:58.850175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:03.571321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:08.787426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:58:19.051Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "da758a5d-f031-4bf7-be17-daf91f738a3c" "maas.apps.38d07d575d4ce9451258.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.13:42218 10.132.1.13:443 10.132.0.10:46034 - v1-completions-path 2026-11-03T17:58:31.692377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:41.965491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:46.497109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:49.488722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:58:52.473613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:09.874861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:20.355370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:22.525900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:30.871193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:34.559464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:52.666303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:59:55.025790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:13.303064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:23.685948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:33.974500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:44.401984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:00:54.742904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:05.136941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:15.641558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:25.877051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:36.252474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:01:46.574127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8