2026-10-31T00:22:56.881888Z info FLAG: --concurrency="0" 2026-10-31T00:22:56.881906Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T00:22:56.881910Z info FLAG: --help="false" 2026-10-31T00:22:56.881913Z info FLAG: --log_as_json="false" 2026-10-31T00:22:56.881915Z info FLAG: --log_caller="" 2026-10-31T00:22:56.881917Z info FLAG: --log_output_level="default:info" 2026-10-31T00:22:56.881919Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T00:22:56.881923Z info FLAG: --log_target="[stdout]" 2026-10-31T00:22:56.881925Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T00:22:56.881927Z info FLAG: --outlierLogPath="" 2026-10-31T00:22:56.881930Z info FLAG: --profiling="true" 2026-10-31T00:22:56.881932Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T00:22:56.881934Z info FLAG: --proxyLogLevel="warning" 2026-10-31T00:22:56.881936Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T00:22:56.881938Z info FLAG: --stsPort="0" 2026-10-31T00:22:56.881940Z info FLAG: --templateFile="" 2026-10-31T00:22:56.881942Z info FLAG: --tokenManagerPlugin="" 2026-10-31T00:22:56.881945Z info FLAG: --vklog="0" 2026-10-31T00:22:56.881947Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T00:22:56.882094Z info Proxy role ips=[10.132.0.34] type=router id=maas-default-gateway-openshift-default-6886b96f9-cnm9b.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T00:22:56.882144Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T00:22:56.883148Z info cpu limit detected as 2, setting concurrency 2026-10-31T00:22:56.883348Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T00:22:56.883359Z info JWT policy is third-party-jwt 2026-10-31T00:22:56.883362Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T00:22:56.884604Z info Starting default Istio SDS Server 2026-10-31T00:22:56.884630Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T00:22:56.884647Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T00:22:56.884971Z info Opening status port 15020 2026-10-31T00:22:56.886219Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T00:22:56.886561Z info sds Starting SDS grpc server 2026-10-31T00:22:56.886593Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T00:22:56.887572Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T00:22:56.888325Z info Starting proxy agent 2026-10-31T00:22:56.888355Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T00:22:56.960776Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T00:22:56.976687Z info cache generated new workload certificate resourceName=default latency=89.974933ms ttl=23h59m59.023318145s 2026-10-31T00:22:56.976741Z info cache Root cert has changed, start rotating root cert 2026-10-31T00:22:56.976788Z info cache returned workload trust anchor from cache ttl=23h59m59.023213452s 2026-10-31T00:22:57.105410Z info ads ADS: new connection for node:1 2026-10-31T00:22:57.105660Z info cache returned workload certificate from cache ttl=23h59m58.894342444s 2026-10-31T00:22:57.106118Z info ads ADS: new connection for node:2 2026-10-31T00:22:57.106403Z info cache returned workload trust anchor from cache ttl=23h59m58.893598345s 2026-10-31T00:22:57.154428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:23:03.377551Z info Readiness succeeded in 6.498803076s 2026-10-31T00:23:03.377853Z info Envoy proxy is ready 2026-10-31T00:24:57.741490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:25:03.028249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:25:09.818186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:25:16.947631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:25:23.184515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:25:31.127485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:26:00.249091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:26:03.744993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:26:33.111612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:26:33.111652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:26:33.111666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:26:33.111671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:26:32.937Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 173 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "b1a117a1-040d-4c87-8bf3-3bee99230841" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:41270 10.132.0.34:443 10.132.0.9:37850 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:26:33.405955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:26:33.405996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:26:33.406013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:26:33.406018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T00:26:33.327Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 78 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "15bc1302-c0cd-446e-baa8-29e3420fa557" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:41284 10.132.0.34:443 10.132.0.9:37872 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:26:33.621Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 497 73 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "55840329-40b4-411b-ac8d-9e4d63f40e66" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:60370 10.132.0.34:443 10.132.0.9:37888 - v1-model-routing [2026-10-31T00:26:34.191Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "52a0f547-ad0b-4d7e-b4e9-7e25eac0454f" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.34:443 10.132.0.9:37900 - v1-model-routing 2026-10-31T00:26:37.421975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:26:37.422017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:26:37.422039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:26:37.422046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:26:37.319Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 103 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "54c64f7d-febd-4678-b64e-9fa98774fe5d" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:41270 10.132.0.34:443 10.132.0.9:37912 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:30:57.026Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 47 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "ef29cf5c-2c53-4fbb-a18d-2844be36324c" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.34:443 10.132.0.9:53122 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:30:58.368Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 93 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "882fd857-64df-44e9-b37b-36f44121e052" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.34:443 10.132.0.9:53134 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:30:59.732867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:30:59.732912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:30:59.732934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T00:30:59.732940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T00:30:59.624Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 108 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "85903b52-299f-433e-b5f9-47f02cf8c7e2" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:51270 10.132.0.34:443 10.132.0.9:53140 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:31:00.631706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:31:00.631746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:31:00.631764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:31:00.631771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:31:00.528Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 103 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "9807c34a-6d5e-49b9-80ee-3ec40422fac7" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:51272 10.132.0.34:443 10.132.0.9:53164 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:31:01.813941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:31:01.813975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:31:01.813989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:31:01.813994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:31:01.701Z] "DELETE /v1/api-keys/e49137bf-874f-4072-80a9-7bd04fd309ec HTTP/1.1" 200 - via_upstream - "-" 0 321 112 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "0db5f360-3a5b-42b8-b06f-7c9b64701be9" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:51270 10.132.0.34:443 10.132.0.9:47560 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:31:03.529261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:31:03.529296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:31:03.529311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T00:31:03.529316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T00:31:03.416Z] "DELETE /v1/api-keys/a5e1c1d7-5326-4908-8968-c53332345b2e HTTP/1.1" 200 - via_upstream - "-" 0 321 112 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "8cd9bc89-a657-4326-bc97-e38cc2f283e1" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:51270 10.132.0.34:443 10.132.0.9:47562 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:31:05.633014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:31:05.633056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:31:05.633076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:31:05.633083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T00:31:05.529Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 103 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "5abc9e5c-d413-460c-b26a-9e95579851f0" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:51272 10.132.0.34:443 10.132.0.9:47582 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:31:13.827261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T00:31:13.821Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 65 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "5bd072b1-cde9-4d5b-9be3-f19970e5b282" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:40880 10.132.0.34:443 10.132.0.9:37964 - v1-completions-path [2026-10-31T00:31:34.933Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 9 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "120ea6fb-c36a-469b-80df-f53e597774b6" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.34:443 10.132.0.9:50280 - - 2026-10-31T00:31:38.838011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:31:38.838049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:31:38.838066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:31:38.838071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T00:31:38.732Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 105 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e64ab32a-c410-46c2-b848-89d9047c5ccb" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:51272 10.132.0.34:443 10.132.0.9:50296 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:37:25.763594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T00:37:26.185296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:37:26.185334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:37:26.185350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:37:26.185355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:37:25.755Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 32 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "a6bdf12c-61f9-455a-a532-92374733cb5a" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.34:443 10.132.0.9:52996 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:37:25.996Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 188 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "10d2e992-9872-4211-a8d0-c935fd8fc8b7" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:53150 10.132.0.34:443 10.132.0.9:53004 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:37:26.616219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:26.616323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:26.616370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:37:26.616397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:27.112570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:27.112722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:27.112788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:27.112818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:37:27.113115Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-31T00:37:27.113229Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:37:27.113264Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:37:27.113287Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:37:27.113310Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T00:37:26.375Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 241 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "16f08fad-27ba-4f4a-a7f7-5e4032b8c186" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:53160 10.132.0.34:443 10.132.0.9:53018 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:37:26.810Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 302 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "05d12d45-9e89-44db-b13a-7712b274d133" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:60370 10.132.0.34:443 10.132.0.9:53028 - v1-completions-path 2026-10-31T00:37:35.598964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:35.599013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:35.599037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:35.599044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:37:35.921379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:35.921429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:35.921447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:37:35.921451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T00:37:35.481Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 117 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "d71d8c86-ddcc-488b-ba94-78da73a80dfa" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:53160 10.132.0.34:443 10.132.0.9:35960 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:37:35.792Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 128 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "c3e276ad-cb7f-4b43-a828-68651c0042e7" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:53160 10.132.0.34:443 10.132.0.9:35968 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:37:36.126Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 3078 84 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "00aba04e-eb7f-423d-af1b-654b6245e871" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:60370 10.132.0.34:443 10.132.0.9:35970 - v1-chat-completions-path [2026-10-31T00:37:39.180Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 6 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "dc5d64c7-7656-45f2-b6ab-069d4979e360" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.34:443 10.132.0.9:35986 - - 2026-10-31T00:37:43.754576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:43.754615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:43.754635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:43.754640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T00:37:44.067202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:44.067238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:44.067254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:44.067259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:37:43.647Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 106 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "a77eeee4-341b-4cfe-b44b-6d8d50ef50aa" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:53160 10.132.0.34:443 10.132.0.9:56912 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:37:43.946Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 121 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "2b6e7f86-e29f-4822-8a42-7f2b4316ee6c" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:53160 10.132.0.34:443 10.132.0.9:56916 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:37:44.260Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 373 173 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "fc52ce50-db56-4227-adc9-3ea4c9c4807c" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:60370 10.132.0.34:443 10.132.0.9:56928 - v1-chat-completions-path 2026-10-31T00:37:49.301448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:49.301490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:49.301516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:49.301523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:37:49.159Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 141 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "c08399c1-4380-9e72-8bb7-3bbe3f41d833" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:53160 10.132.0.34:443 10.132.0.9:56944 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:37:56.130539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:56.130573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:56.130587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:37:56.130591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:37:56.122Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 7 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e5f31512-70d2-4bb8-ae97-a8cb07887b13" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:53160 10.132.0.34:443 10.132.0.9:41908 - odh-ai-gateway-infra.maas-api-route.4 2026-10-31T00:38:02.416425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:38:45.835770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:40:36.366862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:41:38.115047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:51:29.527003Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T00:52:42.916510Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:54:32.100152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:55:57.313883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:01:41.585529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:01:41.585562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:01:41.585576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:01:41.585581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T01:01:41.417Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 168 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "a02251a1-edc1-44a0-9773-dc5cf667e15c" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:45948 10.132.0.34:443 10.132.0.9:48372 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:01:46.372066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:01:46.372102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:01:46.372115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T01:01:46.372120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T01:01:46.266Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 105 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "8c77835e-f556-43a5-ae77-09d6d05dea2c" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:45948 10.132.0.34:443 10.132.0.9:48398 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:01:48.242845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:02:12.531986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:03:07.460555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:03:13.698Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 83 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "b70e7941-1114-4f2c-a4f8-18fdb2d8a38e" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:53024 10.132.0.34:443 10.132.0.9:32844 - v1-completions-path [2026-10-31T01:03:15.232Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "bdfde4b6-87ca-4ef2-af15-5c3225733037" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.34:443 10.132.0.9:32860 - v1-completions-path 2026-10-31T01:03:28.860015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:03:35.191897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:03:45.854Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 62 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e79869e0-af2c-4c31-be02-fe4a5a1af6a1" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:53024 10.132.0.34:443 10.132.0.9:34564 - v1-completions-path [2026-10-31T01:03:59.261Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 68 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "22e72b3b-5f3d-4f4b-9293-4561a7aef984" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:60370 10.132.0.34:443 10.132.0.9:50144 - v1-completions-path 2026-10-31T01:04:00.580082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:04:17.733456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:04:28.288Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "fac98a88-0edc-4a96-b139-4c5124cdf4e3" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:55190 10.132.0.34:443 10.132.0.9:53278 - v1-completions-path [2026-10-31T01:04:30.120Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 55 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e7f0dd33-d942-49f8-872a-826e0a11ca94" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:55190 10.132.0.34:443 10.132.0.9:53290 - v1-completions-path 2026-10-31T01:04:48.450172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:04:59.249327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:05:05.629497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:05:18.656Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "41b3641a-b064-4019-b5c1-a238990d6956" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:55190 10.132.0.34:443 10.132.0.9:48310 - v1-completions-path [2026-10-31T01:05:19.187Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 53 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "62c0ddec-5cdd-40fa-88a5-0577fb135ef5" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:55190 10.132.0.34:443 10.132.0.9:48320 - v1-completions-path [2026-10-31T01:05:19.974Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "58a891ab-11e8-4674-ba04-74c3a0e60a05" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:53024 10.132.0.34:443 10.132.0.9:48326 - v1-completions-path 2026-10-31T01:05:34.561044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:05:39.093649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:06:02.664140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:06:09.153780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:06:35.398651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:06:57.560493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:07:10.818244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:07:16.666117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:07:37.774Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "8e4e7f62-15e5-4153-b386-7a031059abca" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.34:443 10.132.0.9:51534 - v1-completions-path 2026-10-31T01:07:41.878098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:07:47.486634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:08:06.335812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:08:27.986590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:08:38.767904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:08:57.967222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:09:03.647960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:11:28.512Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 48 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "e300f412-cee7-49b2-9a16-1f04222c1c6e" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.34:443 10.132.0.9:35268 - v1-completions-path 2026-10-31T01:13:04.251708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:13:21.844400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:13:26.697686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:13:50.967673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:16:01.727632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:16:41.394028Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:11.012779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:26.929278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:34.570206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:44.514376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:49.591821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:57.431479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:17:57.431516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:17:57.431533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:17:57.431538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T01:17:57.374Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 57 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "4ba56bf5-9bf3-4687-b2aa-9ee3ae1c266d" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:60814 10.132.0.34:443 10.132.0.9:39318 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:18:12.473217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:21:47.069891Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:21:47.069916Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:21:47.069919Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T01:21:47.069923Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T01:21:46.838Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 231 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "de90fc83-7974-4408-b1da-6e0912937d94" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.34:443 10.132.0.9:50078 - v1-catch-all-path 2026-10-31T01:21:54.351569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:22:06.280397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:22:27.595083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:22:32.267327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:22:48.679279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:23:00.347698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:23:26.628698Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3