2026-11-02T21:21:25.659158Z info FLAG: --concurrency="0" 2026-11-02T21:21:25.659176Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T21:21:25.659180Z info FLAG: --help="false" 2026-11-02T21:21:25.659183Z info FLAG: --log_as_json="false" 2026-11-02T21:21:25.659185Z info FLAG: --log_caller="" 2026-11-02T21:21:25.659187Z info FLAG: --log_output_level="default:info" 2026-11-02T21:21:25.659189Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T21:21:25.659193Z info FLAG: --log_target="[stdout]" 2026-11-02T21:21:25.659195Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T21:21:25.659197Z info FLAG: --outlierLogPath="" 2026-11-02T21:21:25.659199Z info FLAG: --profiling="true" 2026-11-02T21:21:25.659201Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T21:21:25.659203Z info FLAG: --proxyLogLevel="warning" 2026-11-02T21:21:25.659205Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T21:21:25.659208Z info FLAG: --stsPort="0" 2026-11-02T21:21:25.659209Z info FLAG: --templateFile="" 2026-11-02T21:21:25.659211Z info FLAG: --tokenManagerPlugin="" 2026-11-02T21:21:25.659214Z info FLAG: --vklog="0" 2026-11-02T21:21:25.659216Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T21:21:25.659355Z info Proxy role ips=[10.133.0.209] type=router id=maas-default-gateway-openshift-default-5db77fbd9f-24nqh.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T21:21:25.659398Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T21:21:25.660568Z info cpu limit detected as 2, setting concurrency 2026-11-02T21:21:25.660840Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T21:21:25.660851Z info JWT policy is third-party-jwt 2026-11-02T21:21:25.660854Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T21:21:25.662889Z info Starting default Istio SDS Server 2026-11-02T21:21:25.662910Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T21:21:25.662938Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T21:21:25.663222Z info Opening status port 15020 2026-11-02T21:21:25.664069Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T21:21:25.665309Z info sds Starting SDS grpc server 2026-11-02T21:21:25.665337Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T21:21:25.665621Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T21:21:25.666541Z info Starting proxy agent 2026-11-02T21:21:25.666572Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T21:21:25.730564Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T21:21:25.800650Z info cache generated new workload certificate resourceName=default latency=135.161668ms ttl=23h59m59.199355078s 2026-11-02T21:21:25.800699Z info cache Root cert has changed, start rotating root cert 2026-11-02T21:21:25.800770Z info cache returned workload trust anchor from cache ttl=23h59m59.199231115s 2026-11-02T21:21:25.876280Z info ads ADS: new connection for node:1 2026-11-02T21:21:25.876345Z info cache returned workload certificate from cache ttl=23h59m59.12365648s 2026-11-02T21:21:25.877275Z info ads ADS: new connection for node:2 2026-11-02T21:21:25.877361Z info cache returned workload trust anchor from cache ttl=23h59m59.122640083s 2026-11-02T21:21:25.967014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:21:33.972700Z info Readiness succeeded in 8.316350353s 2026-11-02T21:21:33.973029Z info Envoy proxy is ready 2026-11-02T21:21:37.753778Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:21:46.301579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:21:49.502694Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T21:21:49.415Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 87 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ee23bec7-b6aa-9a1d-9c29-ef907c1eb50b" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:36268 10.133.0.209:443 10.132.0.22:52364 - v1-catch-all-path 2026-11-02T21:22:03.090681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:22:15.251026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:22:18.245260Z info ads ADS: new connection for node:3 2026-11-02T21:22:18.245415Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T21:22:18.245440Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T21:22:22.300033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:05.629649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:29.251947Z info ads ADS: "" 3 terminated 2026-11-02T21:23:29.545575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:34.167158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:23:50.013673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:26:04.117172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:26:04.117219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:26:04.117239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:26:04.117246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-02T21:26:03.984Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 326 132 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "27dfa3e6-9788-4c84-858c-f1281bf0824b" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.209:36812 10.133.0.209:443 10.132.0.22:59142 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:26:23.294390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:26:50.476417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:19.103119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:27:19.103152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:27:19.103167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T21:27:19.103172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-02T21:27:18.987Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 116 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "a716e662-9f15-4944-8e24-8ee974efd8bd" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.209:35450 10.133.0.209:443 10.132.0.22:60834 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:27:21.505555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:36.674372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:40.107033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:27:40.107065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:27:40.107077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T21:27:40.107081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-02T21:27:40.052Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 55 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "7b17d455-fca2-4aaa-84af-8bc7a13ed483" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.209:35450 10.133.0.209:443 10.132.0.22:59840 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:27:42.868166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:54.354494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:27:57.335331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:28:00.522Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 80 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ebf711e4-32be-4497-8885-18773fe89402" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:47988 10.133.0.209:443 10.132.0.22:54994 - v1-completions-path 2026-11-02T21:28:15.351191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:28:32.824686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-02T21:28:32.753Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 72 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "4b30e4b6-d638-4c58-99ed-167295989784" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:41062 10.133.0.209:443 10.132.0.22:34070 - v1-completions-path 2026-11-02T21:29:03.086027Z info ads ADS: new connection for node:4 2026-11-02T21:29:03.091265Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T21:29:03.091315Z info cache read certificate from file resource=file-root:system 2026-11-02T21:29:06.707584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:29:08.025565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:29:36.853045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:29:36.853078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:29:36.853090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T21:29:36.853094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:29:36.853262Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-02T21:29:36.658Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 194 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e1e50039-f2cb-45bc-846f-b818c0391ef6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.209:59054 10.133.0.209:443 10.132.0.22:34250 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:29:51.071185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:29:51.071220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:29:51.071232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:29:51.071238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:29:51.071414Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T21:29:50.879Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1725 192 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6d8f7215-f677-4c2d-915a-b2e26f566fff" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.209:57992 10.133.0.209:443 10.132.0.22:60638 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T21:30:36.669885Z info ads ADS: "" 4 terminated with stream closed 2026-11-02T21:30:36.743770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:30:39.259330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:30:49.500911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:30:53.400Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 73 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "5e31d134-2b49-4215-b1a1-367210856e5e" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:36578 10.133.0.209:443 10.132.0.22:47994 - v1-completions-path 2026-11-02T21:31:07.716064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:12.180955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:31:16.035Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "61d4752a-a7e4-47e6-9c37-a0424da4ac49" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:47988 10.133.0.209:443 10.132.0.22:53552 - v1-completions-path 2026-11-02T21:31:32.220912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:31:50.684302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:31:56.240Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "dd72f11a-2b04-4ae0-8936-da5e2d4de1ef" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:47988 10.133.0.209:443 10.132.0.22:58584 - v1-completions-path 2026-11-02T21:31:59.805965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T21:31:59.751Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "f7dec912-169a-4a14-984b-7afc7bbccb4f" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:36578 10.133.0.209:443 10.132.0.22:53356 - v1-completions-path [2026-11-02T21:32:00.509Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "fd0c2a5e-0eec-45c3-813d-41c1c73ce88e" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:47988 10.133.0.209:443 10.132.0.22:53366 - v1-completions-path 2026-11-02T21:32:19.186163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:32:29.834720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:32:35.996100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:32:48.803Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2df70d45-3368-4e57-9b9f-e03e435b776c" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:47988 10.133.0.209:443 10.132.0.22:56482 - v1-completions-path 2026-11-02T21:33:04.411521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:08.698287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:21.528095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:30.267080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:39.361844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:45.425982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:33:59.290214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:14.329940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:20.051796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:37.991015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:40.147447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:34:40.147485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:34:40.147501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:34:40.147506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T21:34:40.031Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 332 116 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "4e2e1d12-3a9d-4a31-b3d9-bac1a9bbbc38" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.209:59684 10.133.0.209:443 10.132.0.22:55344 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T21:34:40.361Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 57 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "a39c35b3-df49-481e-880c-ca51b69c3f8d" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.209:443 10.132.0.22:55352 - v1-completions-path 2026-11-02T21:34:43.231849Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:34:45.514287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:34:45.514318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:34:45.514332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:34:45.514337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-02T21:34:45.189Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 32 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "7176ddd4-0c4d-461e-b58f-ed8c8a18ac61" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.209:443 10.132.0.22:55366 - v1-completions-path [2026-11-02T21:34:45.405Z] "DELETE /v1/api-keys/d28e870e-40db-465a-9fd1-1b4c83a7a486 HTTP/1.1" 404 - via_upstream - "-" 0 29 108 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "06854b2e-16ae-4223-90b6-c9417d428f29" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.33:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.209:59478 10.133.0.209:443 10.132.0.22:55380 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:34:54.050024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:18.025946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:28.765151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:49.077141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:35:56.507478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:38:22.156910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:39:51.780312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:39:54.428Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 295 84 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "818436ca-9615-444c-979e-694a5cf034d8" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:38274 10.133.0.209:443 10.132.0.22:51924 - v1-completions-path 2026-11-02T21:40:08.987307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:13.763781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:40:14.483Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 139 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b59748c6-4ebb-4c4f-a7d0-2bb3404d9b2f" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:37240 10.133.0.209:443 10.132.0.22:52876 - v1-completions-path 2026-11-02T21:40:26.416602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:42.605884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:40:49.005608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:08.575942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:19.260939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:25.402294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:39.238993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:41:39.239031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:41:39.239047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T21:41:39.239053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-02T21:41:39.123Z] "DELETE /v1/api-keys/0d4af271-5eab-4734-a705-9ce34c833a44 HTTP/1.1" 200 - via_upstream - "-" 0 365 115 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "da8baf8d-309c-40aa-b4d6-941e99ea0d68" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.227:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.209:41508 10.133.0.209:443 10.132.0.22:42862 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:41:52.664338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:41:58.811713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:04.554175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:42:12.052Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "47da4cb2-5ec9-4183-b5e6-29331fba696d" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:36578 10.133.0.209:443 10.132.0.22:56124 - v1-completions-path 2026-11-02T21:42:35.072416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:45.840583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:52.038647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:42:57.909791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:03.312152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:43:03.312192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T21:43:03.312209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T21:43:03.312214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T21:43:03.160Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 151 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "81660c1d-155a-459a-a4d0-288a2d2e36c7" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.133.0.227:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.209:53284 10.133.0.209:443 10.132.0.22:56370 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T21:43:07.141658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T21:43:15.381Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 72 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b80c7db1-4174-462b-872c-5bf1fc42ee57" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.209:47988 10.133.0.209:443 10.132.0.22:34070 - v1-completions-path 2026-11-02T21:43:30.333516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:41.084709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:43:45.655026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:03.882814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:10.807605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:20.092724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:44:41.640682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:01.723288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:14.258146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:33.889129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:44.693606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:45:55.371256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:06.071551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:16.862694Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:27.465808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:46:29.637631Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T21:46:29.637663Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T21:46:29.637667Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T21:46:29.637672Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T21:46:29.614Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 22 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "4a7759ab-f585-4504-8165-859b842d5ca4" "maas.apps.6fa4745d83b81ed2e5ae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.209:443 10.132.0.22:60482 - v1-completions-path