2026-10-30T20:48:35.968308Z info FLAG: --concurrency="0" 2026-10-30T20:48:35.968334Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T20:48:35.968338Z info FLAG: --help="false" 2026-10-30T20:48:35.968340Z info FLAG: --log_as_json="false" 2026-10-30T20:48:35.968347Z info FLAG: --log_caller="" 2026-10-30T20:48:35.968350Z info FLAG: --log_output_level="default:info" 2026-10-30T20:48:35.968352Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T20:48:35.968357Z info FLAG: --log_target="[stdout]" 2026-10-30T20:48:35.968363Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T20:48:35.968365Z info FLAG: --outlierLogPath="" 2026-10-30T20:48:35.968367Z info FLAG: --profiling="true" 2026-10-30T20:48:35.968370Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T20:48:35.968372Z info FLAG: --proxyLogLevel="warning" 2026-10-30T20:48:35.968381Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T20:48:35.968385Z info FLAG: --stsPort="0" 2026-10-30T20:48:35.968388Z info FLAG: --templateFile="" 2026-10-30T20:48:35.968391Z info FLAG: --tokenManagerPlugin="" 2026-10-30T20:48:35.968395Z info FLAG: --vklog="0" 2026-10-30T20:48:35.968406Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T20:48:35.968654Z info Proxy role ips=[10.133.0.36] type=router id=maas-default-gateway-openshift-default-6db586dd6c-8tvvl.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T20:48:35.968726Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T20:48:35.971111Z info cpu limit detected as 2, setting concurrency 2026-10-30T20:48:35.971356Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T20:48:35.971369Z info JWT policy is third-party-jwt 2026-10-30T20:48:35.971372Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T20:48:35.972323Z info Starting default Istio SDS Server 2026-10-30T20:48:35.972345Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T20:48:35.972360Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T20:48:35.972479Z info Opening status port 15020 2026-10-30T20:48:35.973216Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T20:48:35.974617Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T20:48:35.977578Z info sds Starting SDS grpc server 2026-10-30T20:48:35.977697Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T20:48:35.978119Z info Starting proxy agent 2026-10-30T20:48:35.978810Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T20:48:36.045011Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T20:48:36.085575Z info cache generated new workload certificate resourceName=default latency=112.212498ms ttl=23h59m59.914429595s 2026-10-30T20:48:36.085613Z info cache Root cert has changed, start rotating root cert 2026-10-30T20:48:36.085644Z info cache returned workload trust anchor from cache ttl=23h59m59.914356128s 2026-10-30T20:48:36.171272Z info ads ADS: new connection for node:1 2026-10-30T20:48:36.171319Z info cache returned workload certificate from cache ttl=23h59m59.828681858s 2026-10-30T20:48:36.171710Z info ads ADS: new connection for node:2 2026-10-30T20:48:36.171792Z info cache returned workload trust anchor from cache ttl=23h59m59.828209724s 2026-10-30T20:48:36.282393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:48:44.587902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:48:47.035498Z info Readiness succeeded in 11.070216826s 2026-10-30T20:48:47.035973Z info Envoy proxy is ready 2026-10-30T20:48:47.086184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:48:47.112648Z info Readiness succeeded in 11.147372441s [2026-10-30T20:49:30.334Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 60 - "34.228.250.194,10.132.0.10" "curl/7.76.1" "b2a539c1-c5dc-40b4-b381-fefe6e769506" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.132.0.10:57950 - v1-model-routing 2026-10-30T20:49:30.964940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:49:30.964972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:49:30.964984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:49:30.964989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T20:49:30.577Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 82 - "34.228.250.194,10.132.0.10" "curl/7.76.1" "8a4c027b-89a8-4e64-9ab3-cece05c0a924" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.132.0.10:57954 - v1-model-routing [2026-10-30T20:49:30.949Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 15 - "34.228.250.194,10.132.0.10" "curl/7.76.1" "bd0137ec-502b-4806-92c2-096950b13fb9" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:53682 10.133.0.36:443 10.132.0.10:57958 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T20:51:44.417858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:44.417892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:44.417906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:44.417911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T20:51:44.248Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 45 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "07e2c908-7ad7-4070-afad-0710778f6bed" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.36:443 10.132.0.10:56656 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T20:51:44.355Z] "DELETE /v1/api-keys/b28f1860-275f-4737-be99-63dc3794e68d HTTP/1.1" 200 - via_upstream - "-" 0 370 62 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "1c72362f-78de-4ab6-b830-7413ffdf7a0a" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:40712 10.133.0.36:443 10.132.0.10:56658 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T20:51:45.237402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:45.237437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:45.237451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:45.237456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T20:51:45.531607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:45.531646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:45.531666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T20:51:45.531673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T20:51:45.150Z] "DELETE /v1/api-keys/db7da2e2-366d-465e-aef3-75f59d071dc0 HTTP/1.1" 200 - via_upstream - "-" 0 321 87 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "7333cf82-06c5-4360-b330-4b765db7357b" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:40712 10.133.0.36:443 10.132.0.10:56670 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T20:51:45.464Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 66 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "ef4e60a2-951a-48c1-9935-3071c3b2fcd1" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:40728 10.133.0.36:443 10.132.0.10:57030 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T20:51:46.268923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:46.268958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:46.268971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:46.268976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T20:51:46.485986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:46.486020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:46.486034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:46.486039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T20:51:46.854912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:46.854945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:46.854959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T20:51:46.854963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T20:51:46.214Z] "DELETE /v1/api-keys/b4660691-9565-4833-80a5-748b63703f3b HTTP/1.1" 200 - via_upstream - "-" 0 321 54 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "ccf7fed6-fb63-4b06-b758-0b626881b26d" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:40712 10.133.0.36:443 10.132.0.10:57046 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T20:51:46.419Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 66 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "edcee424-dae5-4384-afbc-aa2feeeee24b" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:40728 10.133.0.36:443 10.132.0.10:57056 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T20:51:46.799Z] "DELETE /v1/api-keys/2ac44764-7400-4d39-8886-1b1e4870b24b HTTP/1.1" 200 - via_upstream - "-" 0 321 55 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "58f64a6f-9bd6-4730-b149-0619a7edd8b8" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:40728 10.133.0.36:443 10.132.0.10:57072 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T20:51:47.411430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:47.411476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:47.411495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T20:51:47.411503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T20:51:47.319Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 92 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8c6c2d59-a9e0-4f5e-a468-1600ad97ff4c" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:40712 10.133.0.36:443 10.132.0.10:57084 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T20:51:54.119320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:54.119355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:54.119368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:51:54.119373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T20:51:54.051Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 68 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "3aaf95d8-e439-4cc4-82eb-81da339aaeb0" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:40728 10.133.0.36:443 10.132.0.10:57110 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T20:51:54.378764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T20:51:54.316Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 77 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "6fe703d0-dd91-4f37-b2be-cd6250fa9686" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:49780 10.133.0.36:443 10.132.0.10:57116 - v1-completions-path [2026-10-30T20:51:55.745Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 61 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "77c1accd-23c4-4481-a68f-c062102e4138" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:49780 10.133.0.36:443 10.132.0.10:43020 - v1-completions-path 2026-10-30T20:52:07.039554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:52:21.890005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:55:39.650845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:55:39.650896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T20:55:39.650915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T20:55:39.650921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T20:55:39.556Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 93 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "0eeb7788-3256-4371-803c-3287a1f1e90d" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:43250 10.133.0.36:443 10.132.0.10:45892 - odh-ai-gateway-infra.maas-api-route.4 [2026-10-30T20:55:40.534Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 27 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "4211dc94-1835-4ced-9a0c-4130a9dbe90d" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.36:443 10.132.0.10:45902 - - 2026-10-30T20:56:15.022678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:56:45.317711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:57:23.694955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:58:28.345095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:03:04.447640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:03:26.620503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:03:38.306694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:03:38.306727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:03:38.306741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:03:38.306745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T21:03:38.243Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 62 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "ea0b123e-2ddb-4165-983d-e0f597594f9d" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:33194 10.133.0.36:443 10.132.0.10:34352 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:04:17.204283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:04:35.562763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:04:37.458180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T21:04:42.435Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "8c804851-3583-485d-9a21-297024da195d" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.132.0.10:33438 - v1-completions-path 2026-10-30T21:04:54.254558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:04:56.159193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:04:58.973606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:05:06.566350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:05:16.878838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:05:21.836335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T21:05:21.830Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 71 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "ee61dbfd-7016-4b27-b73a-619746911869" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:44696 10.133.0.36:443 10.132.0.10:39524 - v1-completions-path [2026-10-30T21:05:22.904Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "412fac94-1ba4-49de-879a-5bb303e51d7e" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:44696 10.133.0.36:443 10.132.0.10:39534 - v1-completions-path 2026-10-30T21:05:38.816856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:05:48.949875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:05:50.700421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T21:05:56.682Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "36be8955-bdc9-4b74-a179-53710c84b7ab" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:52646 10.133.0.36:443 10.132.0.10:49568 - v1-completions-path [2026-10-30T21:05:57.569Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "11ea7455-5efc-4194-bed9-feba96d7dcc5" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.63:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:52646 10.133.0.36:443 10.132.0.10:49580 - v1-completions-path 2026-10-30T21:06:09.854487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:06:11.639274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:06:28.184548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:06:30.445492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T21:06:45.682Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 77 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "296c4bed-84ad-4686-afb4-a6d3b56149ba" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:55820 10.133.0.36:443 10.132.0.10:33468 - v1-completions-path 2026-10-30T21:06:46.938756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:06:48.769804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:07:14.755167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:07:25.452003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:07:28.287131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T21:07:35.148Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 61 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "79484aac-7109-4423-9781-c1fcb41599a1" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:49780 10.133.0.36:443 10.132.0.10:58028 - v1-completions-path 2026-10-30T21:07:47.452170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:07:49.690965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T21:08:03.005Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 65 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "02de20d5-ae99-42de-8e86-cf4ba2b25002" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:55820 10.133.0.36:443 10.132.0.10:38376 - v1-completions-path [2026-10-30T21:08:03.131Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 32 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "a4137b1c-5bed-4cd4-87d7-8ec77bdd9b3d" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.132.0.10:38378 - v1-completions-path 2026-10-30T21:08:07.371043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:08:25.898524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:08:36.029886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:09:02.617821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:09:05.494614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:10:28.189207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:10:28.189252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:10:28.189275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:10:28.189282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T21:10:28.120Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 68 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "b07c1819-fd50-4e80-886a-5ebad906f99d" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35112 10.133.0.36:443 10.132.0.10:57472 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:10:40.480840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:10:43.498833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:12:20.731769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:12:34.967276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:12:46.199307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:13:01.009724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:15:07.276828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:15:24.800572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:15:39.818663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:16:01.689906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:16:05.609168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:16:17.737363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:16:28.831209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:16:33.988373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:16:33.988416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:16:33.988433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:16:33.988438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T21:16:33.930Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 57 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "d165c5f2-70e5-4367-854f-12517da6c6ee" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.58:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:46098 10.133.0.36:443 10.132.0.10:58362 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:16:46.038737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:19:02.831320Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T21:19:50.242887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:19:55.432984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:19:58.487143Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 2026-10-30T21:19:58.708076Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T21:19:58.404Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 82 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "6f68f52c-12b6-4274-a2e5-c246fe8b082c" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:55994 10.133.0.36:443 10.132.0.10:34536 - v1-catch-all-path [2026-10-30T21:19:58.647Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 60 - "34.228.250.194,10.132.0.10" "python-requests/2.34.2" "bce26b9a-41bd-4f23-b8d4-06ffa9c96261" "maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:55994 10.133.0.36:443 10.132.0.10:34538 - v1-catch-all-path 2026-10-30T21:20:10.573445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:20:12.309779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:20:26.637429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T21:20:37.339016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9