2026-11-03T06:03:26.641024Z info FLAG: --concurrency="0" 2026-11-03T06:03:26.641041Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T06:03:26.641045Z info FLAG: --help="false" 2026-11-03T06:03:26.641047Z info FLAG: --log_as_json="false" 2026-11-03T06:03:26.641049Z info FLAG: --log_caller="" 2026-11-03T06:03:26.641051Z info FLAG: --log_output_level="default:info" 2026-11-03T06:03:26.641053Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T06:03:26.641057Z info FLAG: --log_target="[stdout]" 2026-11-03T06:03:26.641059Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T06:03:26.641061Z info FLAG: --outlierLogPath="" 2026-11-03T06:03:26.641064Z info FLAG: --profiling="true" 2026-11-03T06:03:26.641066Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T06:03:26.641068Z info FLAG: --proxyLogLevel="warning" 2026-11-03T06:03:26.641070Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T06:03:26.641072Z info FLAG: --stsPort="0" 2026-11-03T06:03:26.641074Z info FLAG: --templateFile="" 2026-11-03T06:03:26.641076Z info FLAG: --tokenManagerPlugin="" 2026-11-03T06:03:26.641078Z info FLAG: --vklog="0" 2026-11-03T06:03:26.641081Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T06:03:26.641212Z info Proxy role ips=[10.134.0.44] type=router id=maas-default-gateway-openshift-default-778b7b5c47-bgxkm.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T06:03:26.641254Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T06:03:26.642722Z info cpu limit detected as 2, setting concurrency 2026-11-03T06:03:26.642901Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T06:03:26.642911Z info JWT policy is third-party-jwt 2026-11-03T06:03:26.642913Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T06:03:26.644044Z info Starting default Istio SDS Server 2026-11-03T06:03:26.644063Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T06:03:26.644080Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T06:03:26.644231Z info Opening status port 15020 2026-11-03T06:03:26.645593Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T06:03:26.646887Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T06:03:26.647696Z info Starting proxy agent 2026-11-03T06:03:26.647713Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T06:03:26.657304Z info sds Starting SDS grpc server 2026-11-03T06:03:26.657327Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T06:03:26.708917Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T06:03:26.819373Z info ads ADS: new connection for node:1 2026-11-03T06:03:26.819837Z info ads ADS: new connection for node:2 2026-11-03T06:03:26.978291Z info cache generated new workload certificate resourceName=default latency=332.502252ms ttl=23h59m59.021712767s 2026-11-03T06:03:26.978323Z info cache Root cert has changed, start rotating root cert 2026-11-03T06:03:26.978361Z info cache returned workload trust anchor from cache ttl=23h59m59.021639819s 2026-11-03T06:03:26.978379Z info cache returned workload certificate from cache ttl=23h59m59.02162095s 2026-11-03T06:03:26.978471Z info cache returned workload trust anchor from cache ttl=23h59m59.021532835s 2026-11-03T06:03:26.978768Z info cache returned workload trust anchor from cache ttl=23h59m59.021232921s 2026-11-03T06:03:27.059038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:03:34.884615Z info Readiness succeeded in 8.246161472s 2026-11-03T06:03:34.884906Z info Envoy proxy is ready [2026-11-03T06:03:52.116Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 385 89 - "44.212.242.249,10.133.0.12" "curl/7.76.1" "820cb7ce-1f31-4144-bb51-b3f7d0d69962" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:57894 10.134.0.44:443 10.133.0.12:40632 - v1-model-routing 2026-11-03T06:03:53.309134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:03:53.309169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:03:53.309181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:03:53.309186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T06:03:53.239Z] "DELETE /v1/api-keys/2bea5501-e709-410e-9d49-ba2ed964fb64 HTTP/1.1" 200 - via_upstream - "-" 0 365 70 - "44.212.242.249,10.133.0.12" "curl/7.76.1" "b1d7573b-775d-4e54-83c4-c7d8d20b6a82" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:44220 10.134.0.44:443 10.133.0.12:40644 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T06:06:43.808Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 56 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "2f1a4889-3889-4fea-9412-aace665e6f0e" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.44:443 10.133.0.12:50194 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T06:06:44.375453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:06:44.375493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:06:44.375538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:06:44.375546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T06:06:44.854847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:06:44.854895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:06:44.854914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T06:06:44.854922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T06:06:44.290Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 85 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "c9b07608-8da6-4094-9a03-cb8cef938366" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:60428 10.134.0.44:443 10.133.0.12:50196 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T06:06:44.781Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 73 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "46884d16-22dc-4bb4-86f8-326929ec6a38" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:60428 10.134.0.44:443 10.133.0.12:50208 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T06:06:45.359713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:06:45.359762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:06:45.359780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T06:06:45.359786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T06:06:44.997Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 56 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "410d840c-bbf3-42d4-acab-952a122e8f81" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.44:443 10.133.0.12:50222 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T06:06:45.289Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 70 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "2735e5be-f6a3-4cff-8dad-462a20e9cb37" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:60428 10.134.0.44:443 10.133.0.12:50234 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T06:06:51.016Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 192 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "c55c66ac-a1bc-4a08-821c-68a46170429c" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:53354 10.134.0.44:443 10.133.0.12:35514 - v1-completions-path 2026-11-03T06:07:02.926659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:07:17.635557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:11:50.581150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:12:10.534730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:12:56.635983Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T06:12:56.636006Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T06:12:56.636009Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-03T06:12:56.636013Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-03T06:12:56.596Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 39 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "12920ccc-bb51-4a76-b32e-ade611f84c43" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.133.0.12:58038 - v1-completions-path 2026-11-03T06:13:01.705626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T06:13:06.680Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 68 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "5eb723f4-e9ef-4d35-a532-e20b7af17cc5" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:37276 10.134.0.44:443 10.133.0.12:38834 - v1-completions-path 2026-11-03T06:13:18.989467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:13:23.656941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:13:29.886180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:13:29.886211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:13:29.886223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:13:29.886229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-03T06:13:29.811Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 75 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "ec90d386-c094-4dac-891d-e22a27014008" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:54806 10.134.0.44:443 10.133.0.12:37566 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T06:13:42.183439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:13:44.608379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:13:48.049032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:13:58.019731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T06:14:03.715Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "2dbc5992-5252-4f4d-9e60-f381987daa4c" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:37276 10.134.0.44:443 10.133.0.12:38500 - v1-completions-path 2026-11-03T06:14:21.098936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:14:31.498455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:14:36.008810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T06:14:43.060Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "94ed0757-629b-4a16-8b8e-19fdf2b00b9c" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:37848 10.134.0.44:443 10.133.0.12:36972 - v1-completions-path [2026-11-03T06:14:43.702Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "83baee50-6b29-4dfc-96d4-3d9a8e809bbb" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:37848 10.134.0.44:443 10.133.0.12:36990 - v1-completions-path [2026-11-03T06:14:44.114Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "38eee073-5a4a-440b-9c80-600c37d00ff9" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:37276 10.134.0.44:443 10.133.0.12:36992 - v1-completions-path 2026-11-03T06:14:56.215808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:14:58.654882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:15:05.640606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T06:15:05.646207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:15:05.646233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:15:05.646245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:15:05.646250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T06:15:05.573Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 72 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "bb76ff38-117c-4548-9797-b694855855ae" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:47810 10.134.0.44:443 10.133.0.12:45204 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T06:15:17.772411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:15:22.354578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:15:40.889489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:15:43.224165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:16:01.121934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:16:11.813121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:16:15.136993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:16:36.330436Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:16:39.348366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:16:53.539407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:16:59.116212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:16:59.116246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:16:59.116259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T06:16:59.116265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T06:16:59.041Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 75 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "ff344754-6148-46e4-8425-048d755cec04" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:36926 10.134.0.44:443 10.133.0.12:39358 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T06:16:59.381Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "7274b1e6-5cd6-4975-b27b-cd7647f80dde" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:37276 10.134.0.44:443 10.133.0.12:39362 - v1-completions-path 2026-11-03T06:17:11.606588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:17:22.015743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T06:17:38.722Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "23d40cfa-99af-4911-90d8-7bf21bed06f4" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.133.0.12:57072 - v1-completions-path 2026-11-03T06:17:41.034446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:17:44.769731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:19:29.138427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:19:32.910094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:21:03.074950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T06:21:03.657Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 292 128 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "7f77b4dc-1b3b-4d8e-95c4-03e90a5367fa" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:59326 10.134.0.44:443 10.133.0.12:34148 - v1-completions-path 2026-11-03T06:21:17.870761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:21:20.180350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:21:39.126606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:23:11.182368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:23:27.837826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:23:49.111780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:24:03.297063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:24:06.236740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-03T06:24:06.242677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:24:06.242713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-03T06:24:06.242731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-03T06:24:06.242737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-03T06:24:06.170Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 71 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "fb4b4715-15db-4a63-a026-1bf51669c5df" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:50836 10.134.0.44:443 10.133.0.12:54336 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T06:24:07.551968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:24:18.431305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:24:22.102455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T06:24:29.627Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "a992ef73-15cb-4d72-964e-f449a012d41f" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:37276 10.134.0.44:443 10.133.0.12:56136 - v1-completions-path [2026-11-03T06:24:29.935Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "c8c85156-1942-46c8-bece-65d2839fcb37" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.133.0.12:56146 - v1-completions-path 2026-11-03T06:24:41.986135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:27:32.771670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:27:41.250482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:27:46.571979Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T06:27:46.488Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 84 - "44.212.242.249,10.133.0.12" "python-requests/2.34.2" "95b0dbbf-2c6a-496a-bd7a-7a1697a6823b" "maas.apps.a3c09cf78a357df5f249.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:60766 10.134.0.44:443 10.133.0.12:59462 - v1-catch-all-path 2026-11-03T06:27:59.025814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:28:01.150313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:28:16.305574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T06:28:27.156264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8