2026-11-02T22:15:25.622671Z info FLAG: --concurrency="0" 2026-11-02T22:15:25.622691Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T22:15:25.622696Z info FLAG: --help="false" 2026-11-02T22:15:25.622698Z info FLAG: --log_as_json="false" 2026-11-02T22:15:25.622700Z info FLAG: --log_caller="" 2026-11-02T22:15:25.622702Z info FLAG: --log_output_level="default:info" 2026-11-02T22:15:25.622705Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T22:15:25.622709Z info FLAG: --log_target="[stdout]" 2026-11-02T22:15:25.622711Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T22:15:25.622713Z info FLAG: --outlierLogPath="" 2026-11-02T22:15:25.622761Z info FLAG: --profiling="true" 2026-11-02T22:15:25.622763Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T22:15:25.622765Z info FLAG: --proxyLogLevel="warning" 2026-11-02T22:15:25.622767Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T22:15:25.622769Z info FLAG: --stsPort="0" 2026-11-02T22:15:25.622771Z info FLAG: --templateFile="" 2026-11-02T22:15:25.622773Z info FLAG: --tokenManagerPlugin="" 2026-11-02T22:15:25.622776Z info FLAG: --vklog="0" 2026-11-02T22:15:25.622779Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T22:15:25.622935Z info Proxy role ips=[10.132.0.47] type=router id=maas-default-gateway-openshift-default-76f4876667-fzph7.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T22:15:25.622984Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T22:15:25.624403Z info cpu limit detected as 2, setting concurrency 2026-11-02T22:15:25.624604Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T22:15:25.624639Z info JWT policy is third-party-jwt 2026-11-02T22:15:25.624645Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T22:15:25.626893Z info Starting default Istio SDS Server 2026-11-02T22:15:25.626922Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T22:15:25.626947Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T22:15:25.627590Z info Opening status port 15020 2026-11-02T22:15:25.628015Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T22:15:25.628713Z info sds Starting SDS grpc server 2026-11-02T22:15:25.628732Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T22:15:25.629470Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T22:15:25.630241Z info Starting proxy agent 2026-11-02T22:15:25.630273Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T22:15:25.702815Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T22:15:25.779659Z info cache generated new workload certificate resourceName=default latency=150.777681ms ttl=23h59m59.220346979s 2026-11-02T22:15:25.779709Z info cache Root cert has changed, start rotating root cert 2026-11-02T22:15:25.779754Z info cache returned workload trust anchor from cache ttl=23h59m59.220247338s 2026-11-02T22:15:25.858157Z info ads ADS: new connection for node:1 2026-11-02T22:15:25.858239Z info cache returned workload trust anchor from cache ttl=23h59m59.141762726s 2026-11-02T22:15:25.858280Z info ads ADS: new connection for node:2 2026-11-02T22:15:25.858352Z info cache returned workload certificate from cache ttl=23h59m59.141649904s 2026-11-02T22:15:25.938397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:15:33.774064Z info Readiness succeeded in 8.154362536s 2026-11-02T22:15:33.774415Z info Envoy proxy is ready 2026-11-02T22:15:33.817357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:15:35.843986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:16:17.746Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 64 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "23cdfc9a-1e3a-43f5-9179-e28eb544c7e3" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.10:45444 - v1-model-routing [2026-11-02T22:16:18.574Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 57 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "54e534f9-4b0b-4f71-81a9-bb326f36afb7" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.10:45456 - v1-model-routing 2026-11-02T22:20:57.021727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:20:57.021761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:20:57.021774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T22:20:57.021779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T22:20:56.883Z] "DELETE /v1/api-keys/9ae64f3e-4b9e-4921-ae3c-c2c59fe2233b HTTP/1.1" 200 - via_upstream - "-" 0 321 138 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "e8eca53c-f60b-41e1-92b3-b33c0bae70ae" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:57930 10.132.0.47:443 10.132.0.10:49578 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:20:59.377425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:20:59.377458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:20:59.377470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:20:59.377475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T22:20:59.263Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 113 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "bc7ccc73-3a90-47ff-afb8-3de360918d3b" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:57930 10.132.0.47:443 10.132.0.10:49592 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:21:01.066706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:01.066741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:01.066753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T22:21:01.066758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T22:21:00.954Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 112 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "91c50f47-13c3-4bef-b35b-6634962dbea2" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:57940 10.132.0.47:443 10.132.0.10:49602 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:21:11.421747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:11.421785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:11.421802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:11.421809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T22:21:11.308Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 112 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8de60b4a-0188-4ddd-bbc5-80c8bc12544f" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:57940 10.132.0.47:443 10.132.0.10:42404 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:21:12.561991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:12.562025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:12.562038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:12.562042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T22:21:12.450Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 111 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "349abedd-a8a3-4c88-a780-c8f502353227" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:57940 10.132.0.47:443 10.132.0.10:42420 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T22:21:17.432Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 17 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "4529e29d-6bc5-4901-b9fb-56f2b508f48b" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.47:443 10.132.0.10:52324 - - 2026-11-02T22:21:19.434332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:19.434391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:19.434410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:21:19.434417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T22:21:19.289Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 145 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8b64c52c-08e3-4b54-a901-ee1e97f410b5" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:57940 10.132.0.47:443 10.132.0.10:52342 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T22:21:19.619Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 135 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "fcf36d0d-f8dd-4896-8ed4-a0abc8794f32" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:57722 10.132.0.47:443 10.132.0.10:52344 - v1-completions-path 2026-11-02T22:21:20.283385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:21:42.628998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:27:13.400463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:27:13.400610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:27:13.400675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:27:13.400705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T22:27:13.069Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 331 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "9b9c557a-5725-4296-8cb2-6fbe0fc3852c" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:51728 10.132.0.47:443 10.132.0.10:49914 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T22:27:22.708Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 150 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "c10fb2b9-bb9f-4488-8cda-b941a7273773" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.47:443 10.132.0.10:60190 - - 2026-11-02T22:28:38.796098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:29:05.176412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:30:24.368636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:35:25.091881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:35:48.618083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:36:46.172478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:36:52.742179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T22:36:52.733Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 93 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "34ffc2a3-6d05-443c-bfdc-a3f567afa375" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:59416 10.132.0.47:443 10.132.0.10:33374 - v1-completions-path 2026-11-02T22:36:53.889161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T22:36:53.833Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8c3ef898-34cf-4409-9892-a658b34d76c4" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.10:33376 - v1-completions-path 2026-11-02T22:37:07.573091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:37:12.104717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:37:39.034487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:38:05.721148Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:38:14.983Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "5ccbb6b1-5584-422a-ba26-ab46b56aedd2" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:59416 10.132.0.47:443 10.132.0.10:60268 - v1-completions-path [2026-11-02T22:38:19.448Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "3183362c-5d55-4147-8751-98ca01ddec3f" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:55904 10.132.0.47:443 10.132.0.10:60270 - v1-completions-path 2026-11-02T22:38:36.449819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:38:47.182787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:38:53.527663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:39:08.165Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 63 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "52d9d37b-0f0c-4972-a008-20182bd6a329" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:59416 10.132.0.47:443 10.132.0.10:45570 - v1-completions-path [2026-11-02T22:39:08.934Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "cad823dc-caef-4aff-8ff7-fa2fdeb34224" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:55904 10.132.0.47:443 10.132.0.10:45572 - v1-completions-path [2026-11-02T22:39:10.695Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "7c9bd693-4b98-4d02-a608-f923a17eb9d9" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:59416 10.132.0.47:443 10.132.0.10:45578 - v1-completions-path [2026-11-02T22:39:11.721Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "a86a0784-0cfe-47e8-a244-9564c2a7ca27" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:59416 10.132.0.47:443 10.132.0.10:45588 - v1-completions-path [2026-11-02T22:39:11.965Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 95 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "e79f34fb-41f2-45d5-b871-fe3edca492f6" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:59416 10.132.0.47:443 10.132.0.10:45600 - v1-completions-path 2026-11-02T22:39:25.677035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:39:30.300681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:39:53.765350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:40:00.132590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:40:26.264335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:40:48.387873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:01.422973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:07.390859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:32.145667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:37.465481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:48.130831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:41:48.130861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:41:48.130872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:41:48.130877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T22:41:48.020Z] "DELETE /v1/api-keys/c567e0e8-d3c7-45bf-9393-3fdca358dcc4 HTTP/1.1" 404 - via_upstream - "-" 0 29 110 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "b312d68e-0959-4c0b-891c-8cc2656084c0" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:50882 10.132.0.47:443 10.132.0.10:38038 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:41:57.916007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:42:17.358Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "df8be31d-8706-4aed-b44b-31909ba6aca2" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:55904 10.132.0.47:443 10.132.0.10:44860 - v1-completions-path 2026-11-02T22:42:31.163838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:42:41.873316Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:43:11.175892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:43:16.948561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:45:23.513761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:45:23.513800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:45:23.513816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T22:45:23.513820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T22:45:23.287Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 226 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "fca2f1e0-3b2d-4d1d-ba93-893080feccc3" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:36376 10.132.0.47:443 10.132.0.10:55120 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:45:38.817395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:45:44.668829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:47:27.775727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:47:45.268617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:47:49.864848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:48:00.358Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 74 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "9b0ecce7-3212-4291-8bc7-6a02d13c8f13" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:56880 10.132.0.47:443 10.132.0.10:57604 - v1-completions-path 2026-11-02T22:48:11.412228Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T22:48:14.382924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:50:18.495109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:50:59.126823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:51:25.157656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:51:25.157698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:51:25.157715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T22:51:25.157720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T22:51:25.091Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 66 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "a2d5238c-54cf-4ac3-a77a-99bf320b7ac4" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:33620 10.132.0.47:443 10.132.0.10:51546 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:51:27.275199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:51:43.186419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:51:52.209643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:52:06.009999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:52:10.978901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:52:19.991Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "989f816e-6ba3-4899-b2fd-ca44b5d5338b" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.10:50778 - v1-completions-path 2026-11-02T22:52:33.877958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:56:36.967974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:56:43.287416Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T22:56:43.203Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 84 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "765ac434-8b31-49db-b465-395f6c92cec3" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:50840 10.132.0.47:443 10.132.0.10:46888 - v1-catch-all-path 2026-11-02T22:56:48.290652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:57:04.220548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:57:04.220581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:57:04.220595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:57:04.220600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T22:57:04.896854Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-02T22:57:04.103Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 117 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "71c028ad-680d-48a6-a428-ef9c1bf6c955" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.132.0.112:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.47:54050 10.132.0.47:443 10.132.0.10:43686 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T22:57:04.826Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 70 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8b2c6b97-bfeb-4407-b83d-50b261206bad" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.47:43454 10.132.0.47:443 10.132.0.10:43692 - v1-catch-all-path [2026-11-02T22:57:05.677Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 57 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "369981b7-176a-461c-969d-2826d0a919c4" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.47:443 10.132.0.10:43696 - v1-catch-all-path 2026-11-02T22:57:19.276177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:57:23.997258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:57:48.444735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:58:00.495488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8