2026-10-30T21:34:02.380672Z info FLAG: --concurrency="0" 2026-10-30T21:34:02.380690Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T21:34:02.380694Z info FLAG: --help="false" 2026-10-30T21:34:02.380696Z info FLAG: --log_as_json="false" 2026-10-30T21:34:02.380698Z info FLAG: --log_caller="" 2026-10-30T21:34:02.380700Z info FLAG: --log_output_level="default:info" 2026-10-30T21:34:02.380703Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T21:34:02.380707Z info FLAG: --log_target="[stdout]" 2026-10-30T21:34:02.380709Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T21:34:02.380711Z info FLAG: --outlierLogPath="" 2026-10-30T21:34:02.380714Z info FLAG: --profiling="true" 2026-10-30T21:34:02.380716Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T21:34:02.380718Z info FLAG: --proxyLogLevel="warning" 2026-10-30T21:34:02.380721Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T21:34:02.380723Z info FLAG: --stsPort="0" 2026-10-30T21:34:02.380725Z info FLAG: --templateFile="" 2026-10-30T21:34:02.380726Z info FLAG: --tokenManagerPlugin="" 2026-10-30T21:34:02.380729Z info FLAG: --vklog="0" 2026-10-30T21:34:02.380732Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T21:34:02.380882Z info Proxy role ips=[10.133.0.29] type=router id=maas-default-gateway-openshift-default-67bf986f99-zfpbl.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T21:34:02.380931Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T21:34:02.381971Z info cpu limit detected as 2, setting concurrency 2026-10-30T21:34:02.382154Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T21:34:02.382165Z info JWT policy is third-party-jwt 2026-10-30T21:34:02.382168Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T21:34:02.384307Z info Starting default Istio SDS Server 2026-10-30T21:34:02.384334Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T21:34:02.384383Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T21:34:02.384741Z info Opening status port 15020 2026-10-30T21:34:02.385692Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T21:34:02.387443Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T21:34:02.388591Z info Starting proxy agent 2026-10-30T21:34:02.388630Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T21:34:02.396587Z info sds Starting SDS grpc server 2026-10-30T21:34:02.396606Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T21:34:02.451827Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T21:34:02.602275Z info ads ADS: new connection for node:1 2026-10-30T21:34:02.603262Z info ads ADS: new connection for node:2 2026-10-30T21:34:02.699412Z info cache generated new workload certificate resourceName=default latency=313.933023ms ttl=23h59m59.300591975s 2026-10-30T21:34:02.699445Z info cache Root cert has changed, start rotating root cert 2026-10-30T21:34:02.699486Z info cache returned workload trust anchor from cache ttl=23h59m59.300514551s 2026-10-30T21:34:02.699482Z info cache returned workload certificate from cache ttl=23h59m59.300524506s 2026-10-30T21:34:02.699582Z info cache returned workload trust anchor from cache ttl=23h59m59.300418407s 2026-10-30T21:34:02.699888Z info cache returned workload trust anchor from cache ttl=23h59m59.300112851s 2026-10-30T21:34:02.778899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:34:10.703834Z info Readiness succeeded in 8.326308236s 2026-10-30T21:34:10.704178Z info Envoy proxy is ready 2026-10-30T21:34:30.117588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:34:33.232122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T21:35:05.593Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 328 89 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "abf42d8c-f94d-4c90-a3f9-0b69d6f352d9" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:41808 10.133.0.29:443 10.132.0.12:42064 - v1-model-routing [2026-10-30T21:35:06.441Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "7cfc5391-40d9-4d9d-88b3-83673d666938" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.12:55088 - v1-model-routing [2026-10-30T21:35:06.706Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "009e308b-1365-4b7f-9dca-3f6d92d49ec1" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.12:55098 - v1-model-routing [2026-10-30T21:35:07.231Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "88f20d9b-0241-4cd1-89ae-230dd7715fbe" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.12:55104 - v1-model-routing 2026-10-30T21:39:43.776746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:43.776817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:43.776853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:39:43.776863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T21:39:43.661Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 115 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "606d59df-2dcd-426a-9620-3d6093672a32" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:35182 10.133.0.29:443 10.132.0.12:46634 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:39:44.700153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:44.700194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:44.700213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:39:44.700219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T21:39:44.588Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 111 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "1b2c1dd8-1866-4779-aed9-5c2bf6e15894" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:35182 10.133.0.29:443 10.132.0.12:46638 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T21:39:46.020Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 88 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "93a6b950-b8d6-47a2-971f-e52e930f7ae1" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.29:443 10.132.0.12:46648 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:39:46.726741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:46.726779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:46.726793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:46.726798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T21:39:46.614Z] "DELETE /v1/api-keys/ebc16263-8807-4a9a-82cc-d7ed43f648c8 HTTP/1.1" 200 - via_upstream - "-" 0 321 112 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "4eb30566-538a-4f80-a1ef-6bcb83dda2aa" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:35192 10.133.0.29:443 10.132.0.12:43410 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:39:47.227665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:47.227704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:47.227718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:47.227723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T21:39:47.117Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 110 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "fcbbaad3-b048-4d3d-be7d-a6f4f5e7e2f2" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:35192 10.133.0.29:443 10.132.0.12:43416 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T21:39:47.725Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 92 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "e7da93a2-b806-454f-88dc-d48d5936b9df" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.29:443 10.132.0.12:43430 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:39:48.413713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T21:39:48.419511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:48.419545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:48.419560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:48.419565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T21:39:48.309Z] "DELETE /v1/api-keys/9f6c02e9-572f-463b-affd-13dadddf4275 HTTP/1.1" 200 - via_upstream - "-" 0 321 110 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "b745505a-a0dc-45e6-8602-6cad68e6b649" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:35182 10.133.0.29:443 10.132.0.12:43438 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:39:52.307768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:52.307806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:52.307820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:39:52.307825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:52.884672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:52.884708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:52.884723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:39:52.884727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T21:39:52.199Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 108 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "7cb666b7-f335-46c9-8247-6209612ff3b6" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:35182 10.133.0.29:443 10.132.0.12:43464 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T21:39:52.736Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 148 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "46d0d6b7-a142-4117-b47a-04c80912e71e" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:35192 10.133.0.29:443 10.132.0.12:43474 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T21:40:00.718Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 15 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "6ab44ff1-176b-4261-8112-d99092ede51b" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.29:443 10.132.0.12:40230 - - 2026-10-30T21:40:10.739918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:40:10.739954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:40:10.739969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:40:10.739974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T21:40:10.622Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 117 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "107c76e9-2e02-4532-987b-7a4bc91dbc83" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:35182 10.133.0.29:443 10.132.0.12:42166 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:40:13.310574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:40:39.826980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T21:46:23.821Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 38 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c647795e-4949-4587-b451-c32f9f72055d" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.29:443 10.132.0.12:57638 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:49:31.522048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:50:10.716380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:51:55.206316Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:52:45.164310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:56:56.806092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:58:55.881009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:01:46.467904Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T22:02:48.068041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:04:05.027010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:05:33.662005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:05:33.662038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:05:33.662054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:05:33.662058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T22:05:33.488Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 173 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "7da319e1-7743-4151-be93-8bafb4f97da0" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:33674 10.133.0.29:443 10.132.0.12:51538 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:05:41.148136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:06:07.200760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:07:03.446649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:07:08.939678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:07:08.939713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:07:08.939726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:07:08.939731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:07:08.821Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 117 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "0b3e6a22-42c8-4e84-827f-e7eb13e964ff" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:60720 10.133.0.29:443 10.132.0.12:56982 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:07:10.267Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 74 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "6c0c39a6-d7de-49f5-bc7b-b2f4274254f9" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:52028 10.133.0.29:443 10.132.0.12:57004 - v1-completions-path 2026-10-30T22:07:24.806373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:07:29.572994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:07:56.190573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:08:14.984018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T22:08:28.208Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "8802a271-3c6b-4d6a-81bd-bf74a353cdd5" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:52028 10.133.0.29:443 10.132.0.12:48414 - v1-completions-path [2026-10-30T22:08:28.463Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "5c6a76d5-1496-441b-89b8-558d79748554" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:52028 10.133.0.29:443 10.132.0.12:48420 - v1-completions-path [2026-10-30T22:08:29.228Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "ebd51d8b-1937-47be-87b2-52333217d3ed" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:52028 10.133.0.29:443 10.132.0.12:48450 - v1-completions-path 2026-10-30T22:08:30.410168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T22:08:30.358Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "fc3c8410-768a-4bed-905f-680c5b8d4c85" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:37548 10.133.0.29:443 10.132.0.12:48464 - v1-completions-path 2026-10-30T22:08:47.609759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:08:58.498987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:09:03.357175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:09:15.399554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:15.399590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:09:15.399604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:09:15.399609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:09:15.268Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 131 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c43f1afa-0feb-9cff-aed5-de3d879b5eb9" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:49528 10.133.0.29:443 10.132.0.12:40124 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:09:17.145Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 56 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "33fb28f4-7adf-402a-b5c3-4e3b65f66675" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:37548 10.133.0.29:443 10.132.0.12:51468 - v1-completions-path 2026-10-30T22:09:33.247288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:09:38.109166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:10:01.456328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:10:08.119228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:10:34.046163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:10:56.002122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:11:09.258048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:11:15.277000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T22:11:38.923Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 35 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "638636ba-0dca-49e5-b759-1b2747981b92" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.12:51718 - v1-completions-path 2026-10-30T22:11:43.239293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:11:49.027289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:12:10.370699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:12:32.233828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:12:42.943332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:13:02.285885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:13:08.373206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:15:31.224272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:15:37.456921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:17:16.010643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:17:33.457052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:17:38.133088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:18:02.821218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:20:05.356459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:20:48.388979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:21:16.794781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:21:16.794818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:21:16.794833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:21:16.794838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:21:16.663Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 131 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "9a1b56da-5cbc-4948-a341-04a579aec4c5" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:56052 10.133.0.29:443 10.132.0.12:44340 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:21:19.534751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:21:35.034668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:21:53.930983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:22:06.224236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:22:11.339034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:22:40.278282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:26:25.308047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:26:36.025247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:26:57.129514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:27:01.985895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:27:02.450923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:27:02.450959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:27:02.450975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:27:02.450980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:27:02.290Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 160 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c29ec4d9-c902-436f-bbbc-be90ff3b2286" "maas.apps.3442feb0be549fc633ed.prod.konflux-ocp-ci.dev" "10.134.0.146:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:44036 10.133.0.29:443 10.132.0.12:43024 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:27:16.545555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:27:28.310410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7