2026-11-02T15:20:09.698149Z info FLAG: --concurrency="0" 2026-11-02T15:20:09.698177Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T15:20:09.698184Z info FLAG: --help="false" 2026-11-02T15:20:09.698204Z info FLAG: --log_as_json="false" 2026-11-02T15:20:09.698208Z info FLAG: --log_caller="" 2026-11-02T15:20:09.698211Z info FLAG: --log_output_level="default:info" 2026-11-02T15:20:09.698214Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T15:20:09.698222Z info FLAG: --log_target="[stdout]" 2026-11-02T15:20:09.698226Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T15:20:09.698230Z info FLAG: --outlierLogPath="" 2026-11-02T15:20:09.698233Z info FLAG: --profiling="true" 2026-11-02T15:20:09.698237Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T15:20:09.698240Z info FLAG: --proxyLogLevel="warning" 2026-11-02T15:20:09.698245Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T15:20:09.698249Z info FLAG: --stsPort="0" 2026-11-02T15:20:09.698252Z info FLAG: --templateFile="" 2026-11-02T15:20:09.698256Z info FLAG: --tokenManagerPlugin="" 2026-11-02T15:20:09.698261Z info FLAG: --vklog="0" 2026-11-02T15:20:09.698265Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T15:20:09.698499Z info Proxy role ips=[10.133.0.96] type=router id=maas-default-gateway-openshift-default-75fd9f5d47-fxb56.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T15:20:09.698566Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T15:20:09.700881Z info cpu limit detected as 2, setting concurrency 2026-11-02T15:20:09.701287Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T15:20:09.701303Z info JWT policy is third-party-jwt 2026-11-02T15:20:09.701308Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T15:20:09.702929Z info Starting default Istio SDS Server 2026-11-02T15:20:09.702956Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T15:20:09.702983Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T15:20:09.703378Z info Opening status port 15020 2026-11-02T15:20:09.704924Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T15:20:09.705291Z info sds Starting SDS grpc server 2026-11-02T15:20:09.705310Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T15:20:09.706902Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T15:20:09.707924Z info Starting proxy agent 2026-11-02T15:20:09.707966Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T15:20:09.777496Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T15:20:09.863299Z info cache generated new workload certificate resourceName=default latency=157.849259ms ttl=23h59m59.136707694s 2026-11-02T15:20:09.863344Z info cache Root cert has changed, start rotating root cert 2026-11-02T15:20:09.863383Z info cache returned workload trust anchor from cache ttl=23h59m59.136617626s 2026-11-02T15:20:10.009435Z info ads ADS: new connection for node:1 2026-11-02T15:20:10.009506Z info cache returned workload certificate from cache ttl=23h59m58.990497327s 2026-11-02T15:20:10.009746Z info ads ADS: new connection for node:2 2026-11-02T15:20:10.009822Z info cache returned workload trust anchor from cache ttl=23h59m58.99017946s 2026-11-02T15:20:10.101730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:20:19.983041Z info Readiness succeeded in 10.287939442s 2026-11-02T15:20:19.983691Z info Envoy proxy is ready 2026-11-02T15:21:11.069631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:53.738836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:25:04.835364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:33:33.229797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:34:51.601398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:36:26.306373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:37:36.841491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:38:07.979496Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T15:42:23.137523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:42:58.111184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:43:52.050212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:43:58.826Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 90 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "3afd476b-d466-4deb-9d85-cd84ffaed019" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:43100 10.133.0.96:443 10.132.0.7:59984 - v1-completions-path 2026-11-02T15:44:13.639708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:44:27.681884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:44:52.066507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:45:05.304423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:45:11.887686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:45:11.887725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:45:11.887740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:45:11.887746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:45:11.765Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 122 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "2c0ce66e-6e0a-4bd3-8dd9-38fc9159c03b" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.96:47396 10.133.0.96:443 10.132.0.7:58570 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:45:14.612Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 65 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "31b55c95-2c70-406c-9ea1-29c077caefef" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:33560 10.133.0.96:443 10.132.0.7:58592 - v1-completions-path 2026-11-02T15:45:17.570245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T15:45:17.254Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "c623f213-9f3a-47fc-a9fd-784473c63e08" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:43100 10.133.0.96:443 10.132.0.7:58598 - v1-completions-path [2026-11-02T15:45:17.514Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "9b112584-d84a-45e3-be39-f3e4bfd2df64" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:43100 10.133.0.96:443 10.132.0.7:58602 - v1-completions-path 2026-11-02T15:45:36.459826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:45:47.215695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:45:53.484032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:46:04.317140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:46:04.317179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:46:04.317217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:46:04.317223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:46:04.201Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 116 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "a3fbdfd0-6df5-4690-8c8c-151667363931" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.96:42338 10.133.0.96:443 10.132.0.7:43652 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:46:07.364Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "0e87eec3-e437-4242-9072-ddf77c5c3bc5" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:43100 10.133.0.96:443 10.132.0.7:43660 - v1-completions-path [2026-11-02T15:46:07.626Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "3c7916b0-c42d-4187-8692-fd6ee3b5e715" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:33560 10.133.0.96:443 10.132.0.7:43670 - v1-completions-path 2026-11-02T15:46:08.451949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T15:46:08.395Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "22e4f2d9-2200-42ad-ad0f-188159970fe8" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:33560 10.133.0.96:443 10.132.0.7:43682 - v1-completions-path 2026-11-02T15:46:22.072075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:46:26.677639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:46:50.320037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:46:56.786131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:47:23.047040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:47:49.705Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 80 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "9f051556-9f5c-4bb3-afa4-3c4ee8306a5a" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:50290 10.133.0.96:443 10.132.0.7:42396 - v1-completions-path 2026-11-02T15:47:52.164335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:48:05.065429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:48:11.153596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:48:36.718299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:48:42.296772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:48:52.111639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:48:52.111679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:48:52.111692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:48:52.111697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T15:48:51.991Z] "DELETE /v1/api-keys/edeee999-fbe3-4a5a-8781-f65c6837c7a8 HTTP/1.1" 404 - via_upstream - "-" 0 29 120 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "d2123b55-1f0c-4e12-9286-2b9de88abbd4" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.96:59418 10.133.0.96:443 10.132.0.7:50696 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:49:20.724805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:49:38.006Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 67 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "22ee7d17-1117-4fd4-9858-5e095d731d8b" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:43100 10.133.0.96:443 10.132.0.7:54306 - v1-completions-path 2026-11-02T15:49:52.262735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:50:02.933518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:50:17.604Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "4a33a2a6-6781-449a-85ad-d0c6522dd531" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.96:443 10.132.0.7:47142 - v1-completions-path 2026-11-02T15:50:21.757758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:50:27.611215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:53:03.376213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:53:09.452643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:54:26.017872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:54:26.017924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:54:26.017950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T15:54:26.017958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:54:26.267994Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:54:26.268026Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:54:26.268030Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:54:26.268035Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T15:54:25.901Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 116 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "f5678090-9583-4273-b954-91db7fc16169" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.96:49140 10.133.0.96:443 10.132.0.7:47148 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:54:26.223Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 44 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "5fb56ba6-c201-4947-9b55-0ae70ad8f727" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.96:443 10.132.0.7:47152 - v1-completions-path 2026-11-02T15:54:47.301470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:55:04.508273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:55:09.401664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:55:20.368682Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:55:20.368709Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:55:20.368712Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T15:55:20.368716Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T15:55:20.333Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 35 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "6aafab6c-5ee5-4f72-af6b-c896725ff3cf" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.96:443 10.132.0.7:44876 - v1-completions-path 2026-11-02T15:55:33.923423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:57:43.362037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:57:43.362073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:57:43.362089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:57:43.362094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T15:57:43.295Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 66 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "a8e9200e-b022-440c-9128-5ea5c7c82ce4" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.96:46526 10.133.0.96:443 10.132.0.7:37116 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:57:51.916344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:58:34.884241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:59:06.560420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:59:21.973915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:59:28.651638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:59:40.625823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:59:45.639282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:59:59.142Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 70 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "43735c8f-87f5-4906-94ce-8b84e6910a60" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.96:443 10.132.0.7:54002 - v1-completions-path 2026-11-02T15:59:59.739907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:59:59.739953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:59:59.739976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:59:59.739983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:59:59.685Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 54 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "90ec593d-d2b9-47e8-aa30-7ac26a2e9604" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.96:50466 10.133.0.96:443 10.132.0.7:59566 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T16:00:13.339709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:03:58.284535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:04.611905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:04:04.611952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:04:04.611974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T16:04:04.611981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T16:04:04.489Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 122 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "f27ef5f3-c985-4958-a619-c75969556a11" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.134.0.162:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.96:33882 10.133.0.96:443 10.132.0.7:38862 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T16:04:05.631574Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-02T16:04:05.556Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 75 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "78368c0a-d995-48ff-8c2f-36d237acdb66" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:57010 10.133.0.96:443 10.132.0.7:38878 - v1-catch-all-model-routing 2026-11-02T16:04:09.909058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:16.221570Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T16:04:16.151Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 70 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "aeec0101-1569-413a-93fb-2e8b7a9aa6fc" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:50896 10.133.0.96:443 10.132.0.7:58444 - v1-catch-all-path [2026-11-02T16:04:17.291Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 58 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "0cec9423-bb4f-432f-b833-00477a1ac691" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.96:443 10.132.0.7:58446 - v1-catch-all-path 2026-11-02T16:04:30.974346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:35.498863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:38.315782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T16:04:38.315825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T16:04:38.315845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T16:04:38.315852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T16:04:38.575506Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T16:04:38.194Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 121 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "320cc98e-9d79-4784-8139-f17aae23124b" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.133.0.158:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.96:36570 10.133.0.96:443 10.132.0.7:49002 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T16:04:38.512Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 63 - "34.228.250.194,10.132.0.7" "python-requests/2.34.2" "7a2e1016-892e-4fe7-9186-d4ebb69dbf6f" "maas.apps.90c9c9d696e8d039b3d0.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.96:50896 10.133.0.96:443 10.132.0.7:49008 - v1-catch-all-path 2026-11-02T16:04:52.310868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:05:04.069711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8