2026-10-30T00:50:20.351722Z info FLAG: --concurrency="0" 2026-10-30T00:50:20.351744Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T00:50:20.351749Z info FLAG: --help="false" 2026-10-30T00:50:20.351751Z info FLAG: --log_as_json="false" 2026-10-30T00:50:20.351753Z info FLAG: --log_caller="" 2026-10-30T00:50:20.351755Z info FLAG: --log_output_level="default:info" 2026-10-30T00:50:20.351757Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T00:50:20.351761Z info FLAG: --log_target="[stdout]" 2026-10-30T00:50:20.351764Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T00:50:20.351766Z info FLAG: --outlierLogPath="" 2026-10-30T00:50:20.351768Z info FLAG: --profiling="true" 2026-10-30T00:50:20.351769Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T00:50:20.351772Z info FLAG: --proxyLogLevel="warning" 2026-10-30T00:50:20.351774Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T00:50:20.351776Z info FLAG: --stsPort="0" 2026-10-30T00:50:20.351778Z info FLAG: --templateFile="" 2026-10-30T00:50:20.351780Z info FLAG: --tokenManagerPlugin="" 2026-10-30T00:50:20.351782Z info FLAG: --vklog="0" 2026-10-30T00:50:20.351785Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T00:50:20.352004Z info Proxy role ips=[10.133.0.28] type=router id=maas-default-gateway-openshift-default-6db586dd6c-x8j72.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T00:50:20.352055Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T00:50:20.353593Z info cpu limit detected as 2, setting concurrency 2026-10-30T00:50:20.353789Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T00:50:20.353801Z info JWT policy is third-party-jwt 2026-10-30T00:50:20.353804Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T00:50:20.355339Z info Starting default Istio SDS Server 2026-10-30T00:50:20.355367Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T00:50:20.355385Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T00:50:20.355855Z info Opening status port 15020 2026-10-30T00:50:20.357564Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T00:50:20.358879Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T00:50:20.359726Z info Starting proxy agent 2026-10-30T00:50:20.359758Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T00:50:20.367701Z info sds Starting SDS grpc server 2026-10-30T00:50:20.367728Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T00:50:20.414913Z info cache generated new workload certificate resourceName=default latency=56.845257ms ttl=23h59m59.585090866s 2026-10-30T00:50:20.414951Z info cache Root cert has changed, start rotating root cert 2026-10-30T00:50:20.414994Z info cache returned workload trust anchor from cache ttl=23h59m59.58500643s 2026-10-30T00:50:20.432834Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T00:50:20.560360Z info ads ADS: new connection for node:1 2026-10-30T00:50:20.560422Z info cache returned workload certificate from cache ttl=23h59m59.439579366s 2026-10-30T00:50:20.560643Z info ads ADS: new connection for node:2 2026-10-30T00:50:20.560725Z info cache returned workload trust anchor from cache ttl=23h59m59.439276405s 2026-10-30T00:50:20.644148Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:50:28.487276Z info Readiness succeeded in 8.138346543s 2026-10-30T00:50:28.487588Z info Envoy proxy is ready [2026-10-30T00:50:51.817Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 69 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "72968143-f9f1-4a29-bedf-d12e667c71b6" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:35858 - v1-model-routing [2026-10-30T00:50:52.020Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 73 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "9cdcf8bc-c5ad-4ffb-b159-03375f682ca0" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:35864 - v1-model-routing [2026-10-30T00:50:52.124Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "cd71f758-5dec-4d9c-9a35-ec0d5dc6d05d" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:35866 - v1-model-routing 2026-10-30T00:50:52.641017Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T00:50:52.641042Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T00:50:52.641045Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T00:50:52.641049Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T00:50:52.461Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "badcbe41-cf95-46cb-b968-16c075e05895" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:35876 - v1-model-routing [2026-10-30T00:50:52.623Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 17 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "dd5decd0-9d51-49c1-9e59-e698e2a83956" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:35886 - v1-model-routing [2026-10-30T00:53:45.632Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 50 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "1d29ffd6-f278-403c-962b-0eb88906c801" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.28:443 10.132.0.21:45518 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:53:46.936806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:46.936841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:46.936855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T00:53:46.936860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T00:53:46.853Z] "DELETE /v1/api-keys/f2e85d81-b2b3-455d-8a38-4ef2fef0b41b HTTP/1.1" 200 - via_upstream - "-" 0 321 83 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "cc091b47-694d-45ec-a47a-38aa12688a5c" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.28:41630 10.133.0.28:443 10.132.0.21:45522 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:53:53.301382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:53.301427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:53.301441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T00:53:53.301446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T00:53:53.110Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 190 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "fe150851-b36a-4fee-8020-3a49712d828f" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.28:41630 10.133.0.28:443 10.132.0.21:59538 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:53:59.552511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:59.552558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:59.552573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T00:53:59.552578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:59.816506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:59.816548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:53:59.816568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T00:53:59.816575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T00:53:59.481Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 71 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3d5fa985-0229-46de-9ff3-07c343a110ba" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.28:41630 10.133.0.28:443 10.132.0.21:59552 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T00:53:59.735Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 81 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "84b18c2f-1c61-42a5-8278-b472654bbb0e" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.28:41630 10.133.0.28:443 10.132.0.21:59566 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:54:08.498330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:54:24.258179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:59:55.223673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:00:20.176359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:00:37.333142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:01:02.164282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:02:02.244715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:02:41.887040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:22:49.623956Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 [2026-10-30T01:26:48.111Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 326 71 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "cf2cd2fc-bb35-4418-ab35-1d2c312db82d" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.28:42266 10.133.0.28:443 10.132.0.21:54332 - v1-chat-completions-path 2026-10-30T01:26:51.341125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:26:51.341163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:26:51.341176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T01:26:51.341180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:26:51.341376Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-30T01:26:51.341436Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T01:26:51.341445Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T01:26:51.341448Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T01:26:51.341451Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T01:26:51.280Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 61 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "1447d205-e6c8-41da-a3ed-6749fe30f89e" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.28:42280 10.133.0.28:443 10.132.0.21:50182 - v1-chat-completions-path 2026-10-30T01:28:54.078607Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:29:17.219504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:29:58.836962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:30:03.950Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 72 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "07f92d4e-4969-498d-8b4e-53e1854f741a" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.28:53392 10.133.0.28:443 10.132.0.21:48122 - v1-completions-path [2026-10-30T01:30:04.146Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 51 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "8d8ad6fb-d4b7-4122-8cb4-4407d79c231f" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:48134 - v1-completions-path 2026-10-30T01:30:16.018876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:30:20.932900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:30:39.267138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:30:41.648334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:30:44.821185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:30:54.569301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:31:00.752Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "17a45f2e-00d1-44e6-bd63-a3a9b5e98f8d" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.28:46792 10.133.0.28:443 10.132.0.21:59160 - v1-completions-path [2026-10-30T01:31:00.939Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "9a918d67-2ea2-4611-9d2b-a414401e4a2a" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:59170 - v1-completions-path 2026-10-30T01:31:01.462421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T01:31:01.410Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 55 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3cacda56-e9a4-4c05-9d80-075820190e61" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.28:46792 10.133.0.28:443 10.132.0.21:49418 - v1-completions-path 2026-10-30T01:31:18.058175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:31:28.291787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:31:32.424789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:31:37.153Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "eb1af7ec-5805-4fd4-a3cd-1e61bee6d9be" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.28:53392 10.133.0.28:443 10.132.0.21:37850 - v1-completions-path 2026-10-30T01:31:49.742139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:31:51.937060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:32:11.192515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:32:15.481560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:32:31.961846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:32:48.918926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:32:59.590879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:02.641966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:21.554279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:24.154071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:33:43.041Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 37 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "5050927c-9db9-47a1-bdde-f80074e9a640" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:43298 - v1-completions-path 2026-10-30T01:33:45.210432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:33:47.865863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:20.612172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T01:35:20.564Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 47 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "33db0687-9dc5-44ce-b89f-d8f88583f8df" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.28:443 10.132.0.21:49768 - v1-completions-path 2026-10-30T01:35:22.670055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:26.046700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:55.633120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:58.877991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:36:58.878025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:36:58.878036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T01:36:58.878041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T01:36:58.803Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 74 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "0d2cf66a-d857-4063-bfd9-67b042465e8b" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.28:39932 10.133.0.28:443 10.132.0.21:49862 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:37:10.645609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:37:12.769548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:37:27.290598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:38:38.909767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:38:38.909811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:38:38.909831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T01:38:38.909835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T01:38:38.829Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 80 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "75267b3c-db51-440e-8322-2138ccb4d59e" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.28:56460 10.133.0.28:443 10.132.0.21:55574 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:38:44.834188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:39:07.144693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:39:22.360130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:39:34.231319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:39:38.448219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:39:49.832150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:39:53.430830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:13.347196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:22.730516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:30.967071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:36.703392Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T01:40:36.626Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 76 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "71ca456f-5a30-4f9a-aad8-7c4db9bf2370" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.134.0.45:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.28:42354 10.133.0.28:443 10.132.0.21:45418 - v1-catch-all-path 2026-10-30T01:40:44.411536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:46.587208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:49.111015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:40:49.111069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:40:49.111093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T01:40:49.111101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T01:40:48.980Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 130 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "077e6f4c-e130-4df8-a75b-b48918059723" "maas.apps.b9bf3e24ff1e8e8fb6fd.prod.konflux-ocp-ci.dev" "10.134.0.165:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.28:50842 10.133.0.28:443 10.132.0.21:51244 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:41:01.395611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:41:12.285577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8