2026-11-04T01:58:28.441886Z info FLAG: --concurrency="0" 2026-11-04T01:58:28.441908Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:58:28.441912Z info FLAG: --help="false" 2026-11-04T01:58:28.441914Z info FLAG: --log_as_json="false" 2026-11-04T01:58:28.441917Z info FLAG: --log_caller="" 2026-11-04T01:58:28.441919Z info FLAG: --log_output_level="default:info" 2026-11-04T01:58:28.441921Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:58:28.441925Z info FLAG: --log_target="[stdout]" 2026-11-04T01:58:28.441927Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:58:28.441929Z info FLAG: --outlierLogPath="" 2026-11-04T01:58:28.441931Z info FLAG: --profiling="true" 2026-11-04T01:58:28.441933Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:58:28.441935Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:58:28.441937Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:58:28.441939Z info FLAG: --stsPort="0" 2026-11-04T01:58:28.441941Z info FLAG: --templateFile="" 2026-11-04T01:58:28.441943Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:58:28.441945Z info FLAG: --vklog="0" 2026-11-04T01:58:28.441948Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:58:28.442103Z info Proxy role ips=[10.132.1.46] type=router id=maas-default-gateway-openshift-default-fc8c56547-b5lp9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:58:28.442171Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:58:28.443390Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:58:28.443659Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:58:28.443671Z info JWT policy is third-party-jwt 2026-11-04T01:58:28.443674Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:58:28.446358Z info Starting default Istio SDS Server 2026-11-04T01:58:28.446383Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:58:28.446403Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:58:28.446565Z info Opening status port 15020 2026-11-04T01:58:28.447335Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:58:28.448850Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:58:28.449638Z info Starting proxy agent 2026-11-04T01:58:28.449673Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:58:28.457806Z info sds Starting SDS grpc server 2026-11-04T01:58:28.457836Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:58:28.516746Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:58:28.620398Z info cache generated new workload certificate resourceName=default latency=172.779963ms ttl=23h59m59.379607194s 2026-11-04T01:58:28.620437Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:58:28.620481Z info cache returned workload trust anchor from cache ttl=23h59m59.3795225s 2026-11-04T01:58:28.666505Z info ads ADS: new connection for node:1 2026-11-04T01:58:28.666513Z info ads ADS: new connection for node:2 2026-11-04T01:58:28.666650Z info cache returned workload trust anchor from cache ttl=23h59m59.333353378s 2026-11-04T01:58:28.666657Z info cache returned workload certificate from cache ttl=23h59m59.333344618s 2026-11-04T01:58:28.753230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:58:36.959745Z info Readiness succeeded in 8.520154131s 2026-11-04T01:58:36.960168Z info Envoy proxy is ready 2026-11-04T01:58:37.890854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:58:55.092889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:59:06.603680Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:59:09.485163Z info ads ADS: new connection for node:3 2026-11-04T01:59:09.485478Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T01:59:09.485554Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T01:59:13.783075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T01:59:58.425064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:00:07.624Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 329 105 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "6c18df94-506d-4ece-85c9-fde37d3b9e0b" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.178:8000" outbound|54321||e2e-prio-pool-b2b6fa4a-inference-pool-ip-c102c16b.llm.svc.cluster.local 10.132.1.46:44880 10.132.1.46:443 10.132.0.18:39104 - v1-model-routing 2026-11-04T02:00:23.479637Z info ads ADS: "" 3 terminated 2026-11-04T02:00:23.773178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:00:28.929992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:00:46.259344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:03:27.837426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:03:58.224433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:04:28.665540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:04:42.965897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:04:58.602631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:05:11.489057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:05:16.907859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:05:22.927636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:05:22.927675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:05:22.927689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:05:22.927694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T02:05:22.871Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 56 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "31404738-5873-43eb-baf2-31baeea4983f" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.46:37456 10.132.1.46:443 10.132.0.18:56812 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T02:05:36.923475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:05:53.769Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 80 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "fc6fa758-b708-4607-b9e6-0ec2efb0e8f2" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:47714 10.132.1.46:443 10.132.0.18:55204 - v1-completions-path 2026-11-04T02:06:25.038942Z info ads ADS: new connection for node:4 2026-11-04T02:06:25.046821Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T02:06:25.046877Z info cache read certificate from file resource=file-root:system 2026-11-04T02:06:28.800649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:06:30.276300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:06:50.095838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:06:50.095872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:06:50.095881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:06:50.095886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T02:06:50.096030Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-04T02:06:49.887Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1533 208 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "e4a4dbf2-87c7-4a35-807a-419d1f152a4a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.46:43476 10.132.1.46:443 10.132.0.18:51580 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T02:07:16.234063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:07:16.234098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:07:16.234106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:07:16.234111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T02:07:16.234338Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-04T02:07:16.106Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1533 128 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "af366aca-0765-4625-ae3a-afca8112dfab" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.46:43476 10.132.1.46:443 10.132.0.18:48254 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T02:08:05.790632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-04T02:08:05.790711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:08:05.790732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:08:05.790745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:08:05.790750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T02:08:05.790950Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-04T02:08:05.653Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1532 137 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "caeecfaf-dcc0-4d5a-a38f-27bdd71e3a06" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.46:43476 10.132.1.46:443 10.132.0.18:37772 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T02:08:27.446162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:08:30.565262Z info ads ADS: "" 4 terminated 2026-11-04T02:08:30.631328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:08:31.172873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:12:01.686586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:12:07.194Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 61 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "3ee18e7d-d12c-4143-b60b-c001c88414ff" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.46:443 10.132.0.18:39916 - v1-completions-path 2026-11-04T02:12:21.034194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:12:26.001474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:12:28.903631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:12:28.903676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:12:28.903694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T02:12:28.903701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T02:12:28.762Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 141 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "7040693d-fd54-4ba7-a011-8c1fecb604e8" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.46:34288 10.132.1.46:443 10.132.0.18:35252 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T02:12:29.659Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 80 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "757cc9e2-0cfd-4606-bd4c-a9f65e8d4754" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53150 10.132.1.46:443 10.132.0.18:35258 - v1-completions-path 2026-11-04T02:12:30.293854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-04T02:12:30.232Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 69 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "4379a406-6257-4232-8727-85579c410e00" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53158 10.132.1.46:443 10.132.0.18:35280 - v1-completions-path [2026-11-04T02:12:30.880Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 64 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "f49c4294-98c9-4b86-aafb-69c32e2c6a12" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53158 10.132.1.46:443 10.132.0.18:35292 - v1-completions-path [2026-11-04T02:12:32.778Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 61 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "76687540-affc-4fe9-900b-c800a52bdfec" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.46:443 10.132.0.18:50050 - v1-completions-path 2026-11-04T02:12:50.733295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:13:03.721211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:13:15.586Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "19d6844d-75fe-46d2-be34-b519e76a0910" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53158 10.132.1.46:443 10.132.0.18:56772 - v1-completions-path 2026-11-04T02:13:35.030714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:13:46.207559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:13:51.239636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:14:05.665Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 72 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "a7899018-50d2-49de-87e3-0088c90d7c61" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53158 10.132.1.46:443 10.132.0.18:54694 - v1-completions-path 2026-11-04T02:14:20.925671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:14:25.883078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:14:39.989182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:14:49.633333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:14:59.517944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:15:01.128Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 68 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "e315ed63-60d5-4f2a-80ae-44c8b45f2ad8" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:47714 10.132.1.46:443 10.132.0.18:57058 - v1-completions-path 2026-11-04T02:15:06.307474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:15:21.705744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:15:34.391344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:15:40.878176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:15:59.505511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:16:05.332615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:16:17.241895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:16:43.033478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:16:53.962351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:17:12.710619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:17:20.816486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:19:45.481Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 49 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "48136e40-2c10-4105-9db2-42cbafcf15b4" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.46:443 10.132.0.18:43384 - v1-completions-path 2026-11-04T02:19:50.460760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:19:56.827141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:21:23.999382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:21:41.368342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:21:45.767476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:21:58.456963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:22:15.579155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:22:22.012504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:22:22.908159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:22:22.908211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:22:22.908233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T02:22:22.908240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T02:22:22.759Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 148 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "2247179a-bbd6-40a5-bbdf-9421da2be6ec" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.1.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.46:58094 10.132.1.46:443 10.132.0.18:53168 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T02:22:41.581373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:22:52.346760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:22:58.480198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:23:08.647176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:23:08.647209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:23:08.647225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T02:23:08.647230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T02:23:08.960041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:23:08.960077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:23:08.960090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:23:08.960096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T02:23:08.532Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 115 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "ce853ee2-f1e7-4321-8e87-d54d99953d3c" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.193:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.46:35946 10.132.1.46:443 10.132.0.18:40818 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T02:23:08.851Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 108 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "ecf38cb3-04b9-4094-8bf4-598eedde38dc" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.193:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.46:35956 10.132.1.46:443 10.132.0.18:40820 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T02:23:09.165Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 68 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "0287d82f-253c-413c-bb01-718f24d46cf9" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53150 10.132.1.46:443 10.132.0.18:40826 - v1-completions-path 2026-11-04T02:23:11.821277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:23:11.821313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T02:23:11.821330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T02:23:11.821334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T02:23:11.713Z] "DELETE /v1/api-keys/a3482724-c9fb-47e2-984a-c77cf37b2be7 HTTP/1.1" 200 - via_upstream - "-" 0 365 108 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "1f71f9eb-b630-4de0-87dd-fde6382abd03" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.193:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.46:35956 10.132.1.46:443 10.132.0.18:40850 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T02:23:25.513918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:23:29.991960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:23:35.825404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:23:48.788Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 69 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "1002868d-ffd1-4cbb-ac1d-2c389948c616" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53150 10.132.1.46:443 10.132.0.18:56262 - v1-completions-path [2026-11-04T02:23:49.538Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 70 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "2915dfe7-d437-441e-969b-6284593a3c37" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53158 10.132.1.46:443 10.132.0.18:56272 - v1-completions-path [2026-11-04T02:23:51.019Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 61 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "f85ca4d6-6d46-4bbe-9faf-d8d390d93ea3" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.46:443 10.132.0.18:56280 - v1-completions-path 2026-11-04T02:24:05.110490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:24:15.992228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:24:22.464624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:24:28.297314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:24:37.334237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:24:45.417Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "8863e0e0-9aa4-4f50-89de-db6c1c368723" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:53158 10.132.1.46:443 10.132.0.18:56510 - v1-completions-path [2026-11-04T02:24:46.896Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "21b4f205-f4ec-4cd4-8f28-fcdc5f10c8af" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.46:443 10.132.0.18:56532 - v1-completions-path 2026-11-04T02:25:00.655675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:25:11.356001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:25:16.057333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:25:34.112331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:25:39.987410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:25:58.929140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:26:20.869890Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:26:42.843281Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-04T02:26:42.959040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:27:02.059306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:27:12.854233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:27:23.545734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:27:34.376162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:27:45.114650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T02:27:55.671968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-04T02:28:07.558Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 78 - "34.228.250.194,10.132.0.18" "python-requests/2.34.2" "7c625a56-5569-40f5-b148-f248a5bd1850" "maas.apps.aeb4087126d95ff136b4.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.46:46090 10.132.1.46:443 10.132.0.18:33694 - v1-completions-path