2026-10-30T19:18:23.188677Z info FLAG: --concurrency="0" 2026-10-30T19:18:23.188694Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T19:18:23.188699Z info FLAG: --help="false" 2026-10-30T19:18:23.188702Z info FLAG: --log_as_json="false" 2026-10-30T19:18:23.188705Z info FLAG: --log_caller="" 2026-10-30T19:18:23.188708Z info FLAG: --log_output_level="default:info" 2026-10-30T19:18:23.188711Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T19:18:23.188717Z info FLAG: --log_target="[stdout]" 2026-10-30T19:18:23.188721Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T19:18:23.188724Z info FLAG: --outlierLogPath="" 2026-10-30T19:18:23.188728Z info FLAG: --profiling="true" 2026-10-30T19:18:23.188731Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T19:18:23.188734Z info FLAG: --proxyLogLevel="warning" 2026-10-30T19:18:23.188737Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T19:18:23.188740Z info FLAG: --stsPort="0" 2026-10-30T19:18:23.188743Z info FLAG: --templateFile="" 2026-10-30T19:18:23.188745Z info FLAG: --tokenManagerPlugin="" 2026-10-30T19:18:23.188749Z info FLAG: --vklog="0" 2026-10-30T19:18:23.188752Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T19:18:23.188914Z info Proxy role ips=[10.134.0.38] type=router id=maas-default-gateway-openshift-default-855f9574cf-pthrg.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T19:18:23.188966Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T19:18:23.190088Z info cpu limit detected as 2, setting concurrency 2026-10-30T19:18:23.190666Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T19:18:23.190680Z info JWT policy is third-party-jwt 2026-10-30T19:18:23.190684Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T19:18:23.192087Z info Starting default Istio SDS Server 2026-10-30T19:18:23.192116Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T19:18:23.192158Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T19:18:23.192742Z info Opening status port 15020 2026-10-30T19:18:23.193608Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T19:18:23.195290Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T19:18:23.197413Z info sds Starting SDS grpc server 2026-10-30T19:18:23.197434Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T19:18:23.197597Z info Starting proxy agent 2026-10-30T19:18:23.197635Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T19:18:23.260070Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T19:18:23.322502Z info cache generated new workload certificate resourceName=default latency=128.644997ms ttl=23h59m59.677501506s 2026-10-30T19:18:23.322541Z info cache Root cert has changed, start rotating root cert 2026-10-30T19:18:23.322573Z info cache returned workload trust anchor from cache ttl=23h59m59.677427934s 2026-10-30T19:18:23.369446Z info ads ADS: new connection for node:1 2026-10-30T19:18:23.369506Z info cache returned workload certificate from cache ttl=23h59m59.63049503s 2026-10-30T19:18:23.369865Z info ads ADS: new connection for node:2 2026-10-30T19:18:23.369926Z info cache returned workload trust anchor from cache ttl=23h59m59.630074526s 2026-10-30T19:18:23.457304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:18:31.379216Z info Readiness succeeded in 8.192822815s 2026-10-30T19:18:31.379634Z info Envoy proxy is ready 2026-10-30T19:18:47.881288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:18:47.881325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:18:47.881339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T19:18:47.881343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T19:18:47.798Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 82 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "28f73cea-5404-464b-aadb-b73de3861679" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:47720 10.134.0.38:443 10.132.0.13:49962 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:18:48.154Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 356 72 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "e7bafcfb-8069-478a-af4f-347e783b7d64" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:49408 10.134.0.38:443 10.132.0.13:49978 - v1-model-routing [2026-10-30T19:18:49.365Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "34.228.250.194,10.132.0.13" "curl/7.76.1" "f232bc29-ae02-4f8a-9407-a2d0a64dcfb0" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.13:49990 - v1-model-routing 2026-10-30T19:20:46.664636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:20:46.664672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:20:46.664686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:20:46.664691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T19:20:46.601Z] "DELETE /v1/api-keys/ca27761b-6295-4d96-87dc-2017fca93bb1 HTTP/1.1" 200 - via_upstream - "-" 0 321 63 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "60d2ffcc-99bd-43dc-b53e-59a77e83629f" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:56574 10.134.0.38:443 10.132.0.13:36290 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:20:47.713573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:20:47.713607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:20:47.713621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:20:47.713626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T19:20:47.647Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 66 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "ad0755c5-9434-4813-ba65-6f97dd127b26" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:56582 10.134.0.38:443 10.132.0.13:36300 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:20:51.041085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:20:51.041132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:20:51.041154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T19:20:51.041161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T19:20:50.788Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 252 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "67771128-1d3b-462c-864a-6a7f6dbb5cee" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:56582 10.134.0.38:443 10.132.0.13:36312 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:20:56.610582Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T19:20:56.610617Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T19:20:56.610620Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T19:20:56.610624Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T19:20:56.575Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 35 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "b6fb7174-e53f-42ec-bba8-91cc9b258c6d" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.13:47072 - v1-completions-path [2026-10-30T19:20:56.849Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 7 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "32472bc0-db68-45a8-a0b0-df684d2b7b10" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.38:443 10.132.0.13:47084 - - [2026-10-30T19:21:04.481Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 35 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "79134107-aa37-4f22-b30f-d8af9b1e827c" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.13:39186 - v1-completions-path [2026-10-30T19:21:10.778Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 114 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "dd7252be-198a-437e-947f-1a7a8c427ed8" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:49408 10.134.0.38:443 10.132.0.13:39200 - v1-completions-path 2026-10-30T19:21:16.399038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:21:29.455620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:24:11.276836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:24:11.276877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:24:11.276892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:24:11.276897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T19:24:11.207Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 69 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "f6e91d62-2f1c-4fef-91fa-e8e0627f8201" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:54802 10.134.0.38:443 10.132.0.13:56406 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:24:15.723Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 6 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "e61550c4-b932-4d35-ada1-63f1107d07a2" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.38:443 10.132.0.13:51728 - - 2026-10-30T19:25:22.459089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:27:04.198855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:29:24.110519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:30:26.768826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:31:05.357893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:45:52.931807Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 [2026-10-30T19:47:40.169Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 329 78 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "06b1208c-b972-4115-bb52-1ffe79ccfc5d" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:60462 10.134.0.38:443 10.132.0.13:53412 - v1-chat-completions-path 2026-10-30T19:49:52.706703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:50:15.706771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:50:54.240951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T19:50:57.278Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 68 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "92e17367-f6d6-4e0e-94c4-70eddfafe074" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:50900 10.134.0.38:443 10.132.0.13:41738 - v1-completions-path [2026-10-30T19:50:57.507Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "49768ca0-afee-470e-a5aa-e47aaa611687" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:50916 10.134.0.38:443 10.132.0.13:41742 - v1-completions-path [2026-10-30T19:50:57.951Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "2b9abce7-2064-4152-b5f1-08bdd96d700f" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:50916 10.134.0.38:443 10.132.0.13:41748 - v1-completions-path 2026-10-30T19:51:09.620757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:51:11.189928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:51:16.786361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T19:51:16.618Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "4f31ba0d-f25c-4919-a668-80cc6d77954a" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.13:37574 - v1-completions-path [2026-10-30T19:51:16.736Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 51 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "acce41b5-d794-4530-9b2c-7b51e628b836" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.13:37582 - v1-completions-path 2026-10-30T19:51:28.314291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:51:29.792955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:51:32.774932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:51:40.868237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T19:51:48.144Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "545c9717-1e06-4aa2-b32c-342701c78499" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:50916 10.134.0.38:443 10.132.0.13:37130 - v1-completions-path [2026-10-30T19:51:49.691Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 55 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "3372e77e-1ce5-4127-907c-1cdf5c432b4a" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:50900 10.134.0.38:443 10.132.0.13:37148 - v1-completions-path 2026-10-30T19:52:05.633628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:52:15.821973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:52:17.523230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:52:23.303429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:52:23.303466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:52:23.303482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T19:52:23.303488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T19:52:23.303495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-10-30T19:52:23.236Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 67 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5da0cf9e-070e-4037-ac6c-d70b7e9787a5" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:36266 10.134.0.38:443 10.132.0.13:55364 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:52:23.367Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 61 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "d3aaf745-c7db-4ee7-8ef5-86c51d2c4a7b" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:50900 10.134.0.38:443 10.132.0.13:55366 - v1-completions-path [2026-10-30T19:52:23.607Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "d94aa7be-19a3-4946-bd49-ba4b9ebd3b9b" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:50916 10.134.0.38:443 10.132.0.13:55368 - v1-completions-path [2026-10-30T19:52:24.742Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 52 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "3752297b-5718-4f5b-ab23-faaae833786d" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:50916 10.134.0.38:443 10.132.0.13:55370 - v1-completions-path 2026-10-30T19:52:36.615323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:52:38.121041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T19:52:43.430Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 289 69 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5e489b1b-0081-4bfc-b7fd-277bbc59ae11" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:35312 10.134.0.38:443 10.132.0.13:56418 - v1-completions-path 2026-10-30T19:52:54.901120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:52:56.759757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:53:13.619565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:53:15.032386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:53:31.403069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:53:42.039646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:53:44.955901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T19:53:48.727Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 55 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "e871a67e-1950-49b3-9147-ac5f7eb20720" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:49408 10.134.0.38:443 10.132.0.13:48182 - v1-completions-path 2026-10-30T19:54:00.138451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:54:01.537534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:54:20.857770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T19:54:19.958Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 35 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "2376e7b6-8fce-4cbc-8ab5-1fcc0eefbfe3" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.13:52422 - v1-completions-path 2026-10-30T19:54:22.371102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:55:46.049760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:55:48.743377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:57:14.270769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:57:28.954527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:57:30.508428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:57:44.963192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:58:58.899968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:59:16.480724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:59:31.860451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:59:43.886140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:59:47.552595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:59:55.952082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T19:59:58.171179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:00:17.673186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:00:27.193245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:00:30.490259Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-30T20:00:30.417Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 72 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "41d715df-dac8-4e7d-96e4-fd0c5e830ac5" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "10.133.0.50:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:32912 10.134.0.38:443 10.132.0.13:45470 - v1-catch-all-path 2026-10-30T20:00:32.369755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T20:00:36.003Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 54 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "78e741b7-8f19-42bc-8c1d-447ec1e6766f" "maas.apps.48537c84845a5ead0f52.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.13:32916 - v1-catch-all-path 2026-10-30T20:00:46.725080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:00:48.310013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:01:02.491926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T20:01:13.258477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9