2026-11-03T15:09:13.418617Z info FLAG: --concurrency="0" 2026-11-03T15:09:13.418641Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T15:09:13.418645Z info FLAG: --help="false" 2026-11-03T15:09:13.418648Z info FLAG: --log_as_json="false" 2026-11-03T15:09:13.418650Z info FLAG: --log_caller="" 2026-11-03T15:09:13.418651Z info FLAG: --log_output_level="default:info" 2026-11-03T15:09:13.418653Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T15:09:13.418658Z info FLAG: --log_target="[stdout]" 2026-11-03T15:09:13.418660Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T15:09:13.418662Z info FLAG: --outlierLogPath="" 2026-11-03T15:09:13.418664Z info FLAG: --profiling="true" 2026-11-03T15:09:13.418667Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T15:09:13.418669Z info FLAG: --proxyLogLevel="warning" 2026-11-03T15:09:13.418671Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T15:09:13.418672Z info FLAG: --stsPort="0" 2026-11-03T15:09:13.418674Z info FLAG: --templateFile="" 2026-11-03T15:09:13.418676Z info FLAG: --tokenManagerPlugin="" 2026-11-03T15:09:13.418683Z info FLAG: --vklog="0" 2026-11-03T15:09:13.418685Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T15:09:13.418857Z info Proxy role ips=[10.132.1.149] type=router id=maas-default-gateway-openshift-default-855f9574cf-tlmqq.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T15:09:13.418908Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T15:09:13.420395Z info cpu limit detected as 2, setting concurrency 2026-11-03T15:09:13.420970Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T15:09:13.420991Z info JWT policy is third-party-jwt 2026-11-03T15:09:13.420996Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T15:09:13.423426Z info Opening status port 15020 2026-11-03T15:09:13.423440Z info Starting default Istio SDS Server 2026-11-03T15:09:13.423753Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T15:09:13.423789Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T15:09:13.424379Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T15:09:13.426160Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T15:09:13.427354Z info Starting proxy agent 2026-11-03T15:09:13.427445Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T15:09:13.443147Z info sds Starting SDS grpc server 2026-11-03T15:09:13.443190Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T15:09:13.528030Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T15:09:13.586465Z info cache generated new workload certificate resourceName=default latency=161.83936ms ttl=23h59m59.413542488s 2026-11-03T15:09:13.586712Z info cache Root cert has changed, start rotating root cert 2026-11-03T15:09:13.586796Z info cache returned workload trust anchor from cache ttl=23h59m59.413205522s 2026-11-03T15:09:13.728356Z info ads ADS: new connection for node:1 2026-11-03T15:09:13.728460Z info cache returned workload certificate from cache ttl=23h59m59.271541632s 2026-11-03T15:09:13.728510Z info ads ADS: new connection for node:2 2026-11-03T15:09:13.728582Z info cache returned workload trust anchor from cache ttl=23h59m59.271419649s 2026-11-03T15:09:13.813705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:09:21.876094Z info Readiness succeeded in 8.460958835s 2026-11-03T15:09:21.876518Z info Envoy proxy is ready 2026-11-03T15:09:27.573967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:09:39.242479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:09:42.779489Z info ads ADS: new connection for node:3 2026-11-03T15:09:42.779985Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T15:09:42.780061Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T15:09:46.303380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:10:30.610962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:10:52.979Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 43 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "302bb1de-c162-4931-ba30-f84083a8add5" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-3b12e11b-inference-pool-ip-f5e5c752.llm.svc.cluster.local - 10.132.1.149:443 10.132.0.14:44912 - v1-model-routing 2026-11-03T15:10:55.445726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:10:55.465526Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T15:11:00.427126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:11:14.368655Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:13:52.608682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:14:23.176462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:14:54.400283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:15:09.850803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:15:16.589743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:15:16.589786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:15:16.589800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:15:16.589805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T15:15:16.085Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 504 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5aa6e736-fd70-4b22-aa3a-8a1828927f76" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.149:44256 10.132.1.149:443 10.132.0.14:37116 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:15:21.994166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:15:36.587463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:15:43.786048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:16:01.806362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:16:34.727Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 84 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "cd9d33ab-a160-426b-9a17-2e6dabf92797" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:37840 10.132.1.149:443 10.132.0.14:49512 - v1-completions-path [2026-11-03T15:16:35.664Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 69 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "aa53bc7d-280e-431c-8fc2-8bcf894def83" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:37840 10.132.1.149:443 10.132.0.14:49524 - v1-completions-path 2026-11-03T15:16:52.326841Z info ads ADS: new connection for node:4 2026-11-03T15:16:52.332181Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T15:16:52.332239Z info cache read certificate from file resource=file-root:system 2026-11-03T15:16:56.759385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:16:58.053216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:17:01.429193Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"143","StreamId":"1351059695518327199"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 2026-11-03T15:17:01.429320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T15:17:01.361Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 67 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b1078ccb-9b3f-4fd8-82a3-669eb0663395" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.1.149:443 10.132.0.14:45634 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T15:17:08.248656Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"149","StreamId":"16923773127811696190"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=26 [2026-11-03T15:17:08.178Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 70 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "2eaf512a-fc79-400c-ae6f-66761abe318a" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.1.149:443 10.132.0.14:50614 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T15:17:12.894790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:12.894826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:12.894837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:17:12.894841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:17:12.895050Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T15:17:12.775Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 119 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "738d8dce-8678-41e7-bee4-b109e30dd87a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.149:40608 10.132.1.149:443 10.132.0.14:50632 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:17:24.532426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:17:24.532458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:17:24.532467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T15:17:24.532471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:17:24.532606Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T15:17:24.415Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 116 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0ab9b4d5-4c5d-4bc2-9538-5bf713b819a3" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.149:56870 10.132.1.149:443 10.132.0.14:36296 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:18:11.695332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:18:11.695367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:18:11.695377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T15:18:11.695381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:18:11.695569Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-03T15:18:11.580Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 115 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "2e879353-94f8-4736-8efb-ada9bf54b846" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.149:56870 10.132.1.149:443 10.132.0.14:40346 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T15:18:52.679089Z info ads ADS: "" 4 terminated 2026-11-03T15:18:52.735451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:18:57.068347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:19:05.686735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:19:21.533894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:19:26.297513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:19:29.779Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 87 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5cee8e37-9abb-47f5-a6a0-371b439548ab" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:60272 10.132.1.149:443 10.132.0.14:37568 - v1-completions-path 2026-11-03T15:19:32.360627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:19:32.360663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:19:32.360678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:19:32.360683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T15:19:32.305Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 54 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5e7a5bd4-eb14-4221-b0b6-5fddb806f233" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:60272 10.132.1.149:443 10.132.0.14:37584 - v1-catch-all-path [2026-11-03T15:19:44.604Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 64 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b8d9145b-5036-421e-9155-6aa51a24f319" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:37840 10.132.1.149:443 10.132.0.14:32818 - v1-completions-path 2026-11-03T15:19:46.245769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:20:03.317790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:20:10.105700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:20:10.105730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-03T15:20:10.105746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:20:10.105763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T15:20:10.105768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T15:20:09.989Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 115 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "87696974-3bad-4a56-afcb-9a89df4b7fce" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.149:35068 10.132.1.149:443 10.132.0.14:39006 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T15:20:16.439Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a930f2b1-37f6-43d8-907f-d86fd21027a0" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:41678 10.132.1.149:443 10.132.0.14:45684 - v1-completions-path 2026-11-03T15:20:34.454727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:20:45.295731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:20:51.934448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:23.241467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:28.118018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:41.788959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:50.842994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:21:58.946927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:22:08.166441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:22:16.266814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:22:36.944535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:23:08.640084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:23:31.888079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:23:42.601324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:28:35.653559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:28:52.956675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:28:59.439823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:29:14.188704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:29:29.571986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:29:34.770531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:29:54.651621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:05.422747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:11.802255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:30:27.175Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "424bac0a-614c-4a10-8b6e-9bb2701e4b46" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:41678 10.132.1.149:443 10.132.0.14:52264 - v1-completions-path 2026-11-03T15:30:42.047143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:48.479886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:30:54.620287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:31:01.445Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 68 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "bef74c31-37a1-436c-92cb-240ccdf8fd79" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:60272 10.132.1.149:443 10.132.0.14:38896 - v1-completions-path [2026-11-03T15:31:09.015Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f1cc5bb1-23f7-4fbb-99d3-cfcef97ab6f0" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:41678 10.132.1.149:443 10.132.0.14:34816 - v1-completions-path 2026-11-03T15:31:23.655087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:31:34.396165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:31:39.541534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:31:45.986030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:31:54.305445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T15:32:01.935Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 72 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "e08046f0-181b-4564-ba77-a541708cf316" "maas.apps.faf79739dd66677c5df2.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.149:41678 10.132.1.149:443 10.132.0.14:56672 - v1-completions-path 2026-11-03T15:32:17.438419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:28.391802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:33.386642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:51.637130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:32:58.105579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:33:19.561038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:33:39.448249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:33:50.462730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:01.364743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:12.167335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:23.291852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:34.021414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:46.139781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:34:56.091048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:35:06.504904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T15:35:17.146844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9