2026-11-03T00:23:20.030951Z info FLAG: --concurrency="0" 2026-11-03T00:23:20.030969Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T00:23:20.030973Z info FLAG: --help="false" 2026-11-03T00:23:20.030976Z info FLAG: --log_as_json="false" 2026-11-03T00:23:20.030978Z info FLAG: --log_caller="" 2026-11-03T00:23:20.030980Z info FLAG: --log_output_level="default:info" 2026-11-03T00:23:20.030982Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T00:23:20.030986Z info FLAG: --log_target="[stdout]" 2026-11-03T00:23:20.030989Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T00:23:20.030991Z info FLAG: --outlierLogPath="" 2026-11-03T00:23:20.030993Z info FLAG: --profiling="true" 2026-11-03T00:23:20.030995Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T00:23:20.030997Z info FLAG: --proxyLogLevel="warning" 2026-11-03T00:23:20.030999Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T00:23:20.031001Z info FLAG: --stsPort="0" 2026-11-03T00:23:20.031003Z info FLAG: --templateFile="" 2026-11-03T00:23:20.031005Z info FLAG: --tokenManagerPlugin="" 2026-11-03T00:23:20.031007Z info FLAG: --vklog="0" 2026-11-03T00:23:20.031010Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T00:23:20.031165Z info Proxy role ips=[10.134.1.51] type=router id=maas-default-gateway-openshift-default-77bfb58f8c-gt4gv.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T00:23:20.031213Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T00:23:20.032296Z info cpu limit detected as 2, setting concurrency 2026-11-03T00:23:20.032493Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T00:23:20.032503Z info JWT policy is third-party-jwt 2026-11-03T00:23:20.032506Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T00:23:20.034126Z info Starting default Istio SDS Server 2026-11-03T00:23:20.034167Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T00:23:20.034188Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T00:23:20.034526Z info Opening status port 15020 2026-11-03T00:23:20.035887Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T00:23:20.036335Z info sds Starting SDS grpc server 2026-11-03T00:23:20.036369Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T00:23:20.037189Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T00:23:20.037945Z info Starting proxy agent 2026-11-03T00:23:20.037984Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T00:23:20.100847Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T00:23:20.144436Z info cache generated new workload certificate resourceName=default latency=107.994448ms ttl=23h59m59.855568147s 2026-11-03T00:23:20.144467Z info cache Root cert has changed, start rotating root cert 2026-11-03T00:23:20.144499Z info cache returned workload trust anchor from cache ttl=23h59m59.855501369s 2026-11-03T00:23:20.248395Z info ads ADS: new connection for node:2 2026-11-03T00:23:20.248395Z info ads ADS: new connection for node:1 2026-11-03T00:23:20.248468Z info cache returned workload certificate from cache ttl=23h59m59.751533366s 2026-11-03T00:23:20.248476Z info cache returned workload trust anchor from cache ttl=23h59m59.751526082s 2026-11-03T00:23:20.332986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:28.526749Z info Readiness succeeded in 8.498236448s 2026-11-03T00:23:28.527060Z info Envoy proxy is ready 2026-11-03T00:23:32.995400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:42.971940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:23:45.887994Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T00:23:45.792Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 95 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "968b8687-87d8-4d52-bf78-477a3d75594c" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:57928 10.134.1.51:443 10.132.0.10:32908 - v1-catch-all-path 2026-11-03T00:23:59.714891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:24:11.391790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:24:14.777014Z info ads ADS: new connection for node:3 2026-11-03T00:24:14.777226Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:24:14.777259Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T00:24:18.624198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:24:57.681663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:25:22.013347Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T00:25:22.443485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:25:27.396549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:25:43.319079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:27:56.736248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:56.736283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:56.736297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:27:56.736302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:27:56.606Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 326 129 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "61ef2893-29fe-478a-8266-8a1e49d0b9ad" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.51:50290 10.134.1.51:443 10.132.0.10:53278 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:28:17.459477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:28:43.624640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:09.619035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:23.520641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:30.483177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:41.148312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:46.238766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:29:48.937368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:48.937407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:29:48.937426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:29:48.937431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T00:29:48.770Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 166 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "605a7244-3116-40ac-9f82-b7f8ee97a295" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.51:55992 10.134.1.51:443 10.132.0.10:36806 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:30:04.629781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:30:22.317Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 75 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "ed9f707a-c042-43ae-ad06-5efbc3765108" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:56404 10.134.1.51:443 10.132.0.10:37396 - v1-completions-path 2026-11-03T00:30:52.827463Z info ads ADS: new connection for node:4 2026-11-03T00:30:52.833521Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T00:30:52.833622Z info cache read certificate from file resource=file-root:system 2026-11-03T00:30:56.537125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:30:58.117608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:31:45.769823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T00:31:45.908402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:45.908436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:45.908447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:45.908452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:31:45.908619Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:31:45.708Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 199 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "34e789d6-5a61-450a-a801-fa06096becb6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.51:51730 10.134.1.51:443 10.132.0.10:32794 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:31:53.015239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:53.015276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:53.015286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:53.015290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:31:53.015485Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:31:52.812Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 203 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8567bfa5-9758-4f08-9ca2-0462494ead16" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.51:56802 10.134.1.51:443 10.132.0.10:41104 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:31:55.344220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:55.344248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:55.344256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:31:55.344261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:31:55.344415Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T00:31:55.217Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 127 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "a1e53981-5d65-44f7-a0ad-d7496ccca035" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.51:56802 10.134.1.51:443 10.132.0.10:41132 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:31:57.674645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:57.674681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:57.674695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:31:57.674701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T00:31:57.674881Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T00:31:57.546Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 128 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8e0b3156-12a8-4936-aefc-8529aa777d92" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.51:51730 10.134.1.51:443 10.132.0.10:41146 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T00:32:50.441773Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T00:32:50.484944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:32:53.311994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:04.242666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:22.984137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:33:28.012640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:33:33.724Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "96c4dbec-7c0b-4faa-8438-c3cfea963db4" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.51:443 10.132.0.10:41774 - v1-completions-path 2026-11-03T00:33:47.827105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:06.688055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:34:11.933Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 78 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "d28e2f35-c4ce-4269-86ec-7ba1ed79054f" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:60162 10.134.1.51:443 10.132.0.10:48734 - v1-completions-path 2026-11-03T00:34:15.811321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T00:34:15.746Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 65 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "b7438ed3-34b5-4ae0-91b0-04a200738e03" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:60172 10.134.1.51:443 10.132.0.10:48750 - v1-completions-path 2026-11-03T00:34:35.633327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:46.429272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:34:51.245180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:35:03.471Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "52f736b2-88e9-44e4-84a4-bde3f76effcf" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:60162 10.134.1.51:443 10.132.0.10:60088 - v1-completions-path [2026-11-03T00:35:05.591Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "f081296b-88dd-46f1-8e57-4ffe6a04c5b6" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:60172 10.134.1.51:443 10.132.0.10:60096 - v1-completions-path [2026-11-03T00:35:05.862Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 55 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "b04e5b7b-0840-4bc0-93c5-51ec39a89fd6" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:60172 10.134.1.51:443 10.132.0.10:60110 - v1-completions-path [2026-11-03T00:35:06.111Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "21ca745d-38f1-46ff-a155-4904ab532242" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:60172 10.134.1.51:443 10.132.0.10:60124 - v1-completions-path 2026-11-03T00:35:21.357395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:26.319441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:40.010119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:35:44.432Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 74 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "a6e7c879-5576-46b8-9683-5593870abd2a" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:40068 10.134.1.51:443 10.132.0.10:58944 - v1-completions-path 2026-11-03T00:35:49.308505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:35:57.259967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:06.744140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:16.400410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:35.084521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:43.162670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:36:53.592135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:37:06.450184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:37:29.445269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:37:40.058971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:37:45.362951Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:37:45.362991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:37:45.363008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:37:45.363013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T00:37:45.246Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 116 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4fa9bc9e-8cf2-40ff-9a76-536560208943" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.51:46458 10.134.1.51:443 10.132.0.10:39996 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T00:37:56.580Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 38 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "79044634-11a7-4a81-8bd5-95470dfd6cd4" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.51:443 10.132.0.10:33222 - v1-completions-path [2026-11-03T00:40:25.100Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 49 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "835cd9c9-d77b-4dbc-b388-c0bad37e6298" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.51:443 10.132.0.10:50494 - v1-completions-path 2026-11-03T00:41:59.134664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:02.931300Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:42:02.931336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:42:02.931349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:42:02.931353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T00:42:02.813Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 117 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "fee05732-4d42-4d0d-acb4-32d3a671ee5c" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.51:37836 10.134.1.51:443 10.132.0.10:51236 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:42:16.328462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:20.781940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:33.356140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:50.457289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:42:55.138287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:15.189906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:25.729570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:31.808491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:43:42.205275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:43:42.205316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T00:43:42.205336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T00:43:42.205343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T00:43:42.084Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 120 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "b5ba8d08-d660-4a53-a3df-965fa5ef6a63" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.133.0.231:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.51:48078 10.134.1.51:443 10.132.0.10:42426 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:43:45.301515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:43:45.301556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:43:45.301577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T00:43:45.301583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T00:43:44.666Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4ad35b38-2040-4bab-b93e-be3c98a80ee7" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.51:443 10.132.0.10:42440 - v1-completions-path [2026-11-03T00:43:45.185Z] "DELETE /v1/api-keys/de13b61f-5e76-4395-9621-2c036c22b4a4 HTTP/1.1" 200 - via_upstream - "-" 0 365 116 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "0aebd8f0-a56d-499d-90b4-751b48469c50" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.248:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.51:43374 10.134.1.51:443 10.132.0.10:42450 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T00:43:58.989311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:04.969742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:10.668954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:41.772062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:52.500108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:44:58.891984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:04.813219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:45:13.540Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 65 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4e775d4b-496a-4e84-9901-249a93ac01fb" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:60172 10.134.1.51:443 10.132.0.10:58348 - v1-completions-path 2026-11-03T00:45:17.040452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T00:45:26.158Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "9ffa9e9e-498c-411a-b84e-25c7cf3dcd93" "maas.apps.9bf2ce48968e6843c10f.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.51:60172 10.134.1.51:443 10.132.0.10:46034 - v1-completions-path 2026-11-03T00:45:40.367040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:51.368705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:45:56.286614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:13.590373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:23.492447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:46:44.005649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:06.025342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:28.079005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:48.069375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:47:59.082233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:48:09.780886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:48:20.520347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:48:31.370992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T00:48:42.040454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9