2026-11-04T01:33:33.429272Z info FLAG: --concurrency="0" 2026-11-04T01:33:33.429304Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:33:33.429310Z info FLAG: --help="false" 2026-11-04T01:33:33.429366Z info FLAG: --log_as_json="false" 2026-11-04T01:33:33.429370Z info FLAG: --log_caller="" 2026-11-04T01:33:33.429373Z info FLAG: --log_output_level="default:info" 2026-11-04T01:33:33.429376Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:33:33.429383Z info FLAG: --log_target="[stdout]" 2026-11-04T01:33:33.429386Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:33:33.429389Z info FLAG: --outlierLogPath="" 2026-11-04T01:33:33.429392Z info FLAG: --profiling="true" 2026-11-04T01:33:33.429396Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:33:33.429399Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:33:33.429403Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:33:33.429406Z info FLAG: --stsPort="0" 2026-11-04T01:33:33.429409Z info FLAG: --templateFile="" 2026-11-04T01:33:33.429412Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:33:33.429417Z info FLAG: --vklog="0" 2026-11-04T01:33:33.429421Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:33:33.429626Z info Proxy role ips=[10.132.1.103] type=router id=maas-default-gateway-openshift-default-5d84bc6b95-9w54v.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:33:33.429686Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:33:33.430818Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:33:33.431036Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:33:33.431050Z info JWT policy is third-party-jwt 2026-11-04T01:33:33.431054Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:33:33.432646Z info Starting default Istio SDS Server 2026-11-04T01:33:33.432670Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:33:33.432689Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:33:33.432956Z info Opening status port 15020 2026-11-04T01:33:33.433796Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:33:33.434434Z info sds Starting SDS grpc server 2026-11-04T01:33:33.434485Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:33:33.435233Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:33:33.436409Z info Starting proxy agent 2026-11-04T01:33:33.436450Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:33:33.502795Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:33:33.579207Z info cache generated new workload certificate resourceName=default latency=144.645545ms ttl=23h59m59.420800079s 2026-11-04T01:33:33.579260Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:33:33.579304Z info cache returned workload trust anchor from cache ttl=23h59m59.420698634s 2026-11-04T01:33:33.655291Z info ads ADS: new connection for node:1 2026-11-04T01:33:33.655358Z info cache returned workload certificate from cache ttl=23h59m59.344643862s 2026-11-04T01:33:33.656131Z info ads ADS: new connection for node:2 2026-11-04T01:33:33.656230Z info cache returned workload trust anchor from cache ttl=23h59m59.343772473s 2026-11-04T01:33:33.740375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:33:41.574533Z info Readiness succeeded in 8.148385485s 2026-11-04T01:33:41.574866Z info Envoy proxy is ready 2026-11-04T01:33:42.619192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:33:57.140771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:06.870502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:23.152314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:35.094939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:37.587988Z info ads ADS: new connection for node:3 2026-11-04T01:34:37.588184Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T01:34:37.588266Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T01:34:40.514894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:35:21.333167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:35:45.751066Z info ads ADS: "" 3 terminated with stream closed 2026-11-04T01:35:46.128331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:35:51.470324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:08.197168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:38:42.445581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:10.848571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:30.471297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:44.466355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:51.532654Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:40:02.445833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:40:07.557377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:40:11.683Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 72 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e6f6bfb1-1fca-40fd-b5c8-50421156f15b" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.103:443 10.132.0.9:60836 - v1-completions-path 2026-11-04T01:40:25.679950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:40:42.009Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 93 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "70ea07bb-7940-44fa-b6b5-f8bd395a0864" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:56006 10.132.1.103:443 10.132.0.9:36014 - v1-completions-path [2026-11-04T01:40:57.041Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 73 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "16b121b1-c5bb-4cde-a479-8d79538bf63f" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:56006 10.132.1.103:443 10.132.0.9:38516 - v1-completions-path 2026-11-04T01:41:13.689667Z info ads ADS: new connection for node:4 2026-11-04T01:41:13.695691Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T01:41:13.695734Z info cache read certificate from file resource=file-root:system 2026-11-04T01:41:17.311097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:41:18.846761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:41:26.446735Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"143","StreamId":"12434130713575165842"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-04T01:41:26.373Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 73 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ed656eb5-48c6-4fb7-af53-12fa4ade7820" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.1.103:443 10.132.0.9:54026 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-04T01:41:59.899974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:41:59.900014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:41:59.900025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:41:59.900029Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:41:59.900222Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-04T01:41:59.698Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1533 201 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5ac07a78-0099-4727-ac23-979e24ec0a09" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.103:45320 10.132.1.103:443 10.132.0.9:43258 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T01:42:16.610290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T01:42:16.745188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:16.745224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:16.745237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:16.745242Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:42:16.745447Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T01:42:16.550Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1534 195 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ea37001b-f14d-4623-801d-d852353c89a7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.103:53572 10.132.1.103:443 10.132.0.9:38714 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T01:42:26.188206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:26.188243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:26.188258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:26.188264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:42:26.188488Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T01:42:26.066Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1533 121 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e3667b60-e346-47e0-a98d-6159f96da663" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.103:53572 10.132.1.103:443 10.132.0.9:50188 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T01:42:55.594345Z info ads ADS: "" 4 terminated 2026-11-04T01:42:57.100900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:42:58.366419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:09.282294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:11.982146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:43:11.982181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:43:11.982194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:43:11.982199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:43:11.854Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 127 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ee900a26-27c1-401e-ab2f-b54e76998bdc" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.103:49862 10.132.1.103:443 10.132.0.9:50888 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:43:13.701Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 84 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "45d51d03-e40b-490d-8030-c9c1646fbeaf" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:38288 10.132.1.103:443 10.132.0.9:50908 - v1-completions-path [2026-11-04T01:43:14.080Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "9a0a0c5f-7aa7-4d8b-ae87-953b880a06be" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.103:443 10.132.0.9:50922 - v1-completions-path 2026-11-04T01:43:27.781682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:32.677106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:57.264835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:44:10.421002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:44:21.057724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-04T01:44:20.993Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c1fd4a19-dfef-4330-9010-ff41e4fd1aca" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:38288 10.132.1.103:443 10.132.0.9:49038 - v1-completions-path 2026-11-04T01:44:41.597104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:44:52.300721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:44:57.390228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:45:09.638Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "845f359e-1b3a-4a8c-b568-49ab4d27fa45" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:38288 10.132.1.103:443 10.132.0.9:49412 - v1-completions-path [2026-11-04T01:45:09.909Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 70 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "6078426a-78f8-4734-91b8-e9822fb0e1f6" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:38288 10.132.1.103:443 10.132.0.9:49426 - v1-completions-path [2026-11-04T01:45:12.499Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b8a2881f-0b1e-4b85-9a4d-d66945491c4b" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:35448 10.132.1.103:443 10.132.0.9:59940 - v1-completions-path 2026-11-04T01:45:26.961041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:45:31.935016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:45:46.065277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:45:55.470412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:03.572920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:12.939666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:22.655089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:41.208588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:47:04.459Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 35 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "d236d12e-a681-4b99-b3c0-2b8653492635" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.103:443 10.132.0.9:47110 - v1-completions-path 2026-11-04T01:47:12.731497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:47:21.362689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:47:21.362722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:47:21.362734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:47:21.362739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:47:21.251Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 110 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "696c150e-bb25-4f3c-9c83-a0a561211aff" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.103:37022 10.132.1.103:443 10.132.0.9:45032 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:47:36.140146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:47:46.845623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:52:47.777507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:05.034937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:09.620882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:22.311690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:39.994620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:46.530131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:53:51.654Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "bb9d7f0e-f2df-4e8b-bdb1-6aa8e811d3e4" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:35448 10.132.1.103:443 10.132.0.9:53750 - v1-completions-path 2026-11-04T01:54:05.964270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:16.627939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:22.825422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:54:34.235Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 68 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "10f519b5-e08b-4023-a213-57be9d88f756" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:38288 10.132.1.103:443 10.132.0.9:50034 - v1-completions-path [2026-11-04T01:54:35.907Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "453d00bb-a902-4274-8fd2-fdafdd270ad0" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:35448 10.132.1.103:443 10.132.0.9:50054 - v1-completions-path 2026-11-04T01:54:36.898004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:54:36.898040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:54:36.898056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:54:36.898061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:54:36.784Z] "DELETE /v1/api-keys/def861a8-eba8-4fce-93dc-b82760fd34e8 HTTP/1.1" 200 - via_upstream - "-" 0 365 113 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ec8fd2f8-32b5-495a-aa50-c4645e96ad7e" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.240:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.103:44818 10.132.1.103:443 10.132.0.9:50070 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:54:50.741315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:56.902431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:02.779392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:55:12.948Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "f1dfe68d-8c97-4a48-9fcc-ac3d4ad1808f" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.103:443 10.132.0.9:45974 - v1-completions-path [2026-11-04T01:55:15.838Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "800b92df-97a4-4f9b-aa64-063e9c164b8d" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:35448 10.132.1.103:443 10.132.0.9:46004 - v1-completions-path [2026-11-04T01:55:18.790Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5deb5d80-18bf-4e78-99e0-98f66c122585" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:38288 10.132.1.103:443 10.132.0.9:46010 - v1-completions-path 2026-11-04T01:55:20.634229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:20.634265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:20.634279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:55:20.634284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:55:20.523Z] "DELETE /v1/api-keys/c78a7dbd-a684-4c3e-9dee-9757240ac762 HTTP/1.1" 200 - via_upstream - "-" 0 363 110 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e15697e6-bfc2-4200-ae4e-9296a6b3a7ba" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.240:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.103:44818 10.132.1.103:443 10.132.0.9:55080 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:55:34.465218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:45.265043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:51.709502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:59.249826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:56:10.450449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:56:18.009Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "4f9b7c18-9da8-4478-a247-5569fc509bf9" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:38288 10.132.1.103:443 10.132.0.9:34320 - v1-completions-path [2026-11-04T01:56:18.392Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "6c3755cc-dc0b-434a-a922-6846d60438f8" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:35448 10.132.1.103:443 10.132.0.9:34334 - v1-completions-path [2026-11-04T01:56:19.471Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "7dc90ea6-6dc5-4772-a027-85c05c32aa54" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.103:38288 10.132.1.103:443 10.132.0.9:34336 - v1-completions-path 2026-11-04T01:56:33.836701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:56:44.624563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:56:49.416745Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:57:07.810293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:57:13.890226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:57:35.998707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:57:57.877187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:18.139214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:30.652518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:50.675883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:01.583811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:12.288762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:23.159898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:33.745816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8