2026-11-01T06:19:49.763878Z info FLAG: --concurrency="0" 2026-11-01T06:19:49.763905Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T06:19:49.763909Z info FLAG: --help="false" 2026-11-01T06:19:49.763911Z info FLAG: --log_as_json="false" 2026-11-01T06:19:49.763913Z info FLAG: --log_caller="" 2026-11-01T06:19:49.763915Z info FLAG: --log_output_level="default:info" 2026-11-01T06:19:49.763917Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T06:19:49.763921Z info FLAG: --log_target="[stdout]" 2026-11-01T06:19:49.763923Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T06:19:49.763925Z info FLAG: --outlierLogPath="" 2026-11-01T06:19:49.763927Z info FLAG: --profiling="true" 2026-11-01T06:19:49.763929Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T06:19:49.763931Z info FLAG: --proxyLogLevel="warning" 2026-11-01T06:19:49.763933Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T06:19:49.763935Z info FLAG: --stsPort="0" 2026-11-01T06:19:49.763937Z info FLAG: --templateFile="" 2026-11-01T06:19:49.763939Z info FLAG: --tokenManagerPlugin="" 2026-11-01T06:19:49.763941Z info FLAG: --vklog="0" 2026-11-01T06:19:49.763944Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T06:19:49.764085Z info Proxy role ips=[10.132.0.42] type=router id=maas-default-gateway-openshift-default-7d9897b54c-qpmzx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T06:19:49.764134Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T06:19:49.765432Z info cpu limit detected as 2, setting concurrency 2026-11-01T06:19:49.765642Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T06:19:49.765653Z info JWT policy is third-party-jwt 2026-11-01T06:19:49.765657Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T06:19:49.767201Z info Starting default Istio SDS Server 2026-11-01T06:19:49.767287Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T06:19:49.767322Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T06:19:49.768311Z info Opening status port 15020 2026-11-01T06:19:49.768779Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T06:19:49.769588Z info sds Starting SDS grpc server 2026-11-01T06:19:49.769622Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T06:19:49.770379Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T06:19:49.771235Z info Starting proxy agent 2026-11-01T06:19:49.771332Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T06:19:49.835261Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T06:19:49.861332Z info cache generated new workload certificate resourceName=default latency=91.501392ms ttl=23h59m59.138671785s 2026-11-01T06:19:49.861367Z info cache Root cert has changed, start rotating root cert 2026-11-01T06:19:49.861405Z info cache returned workload trust anchor from cache ttl=23h59m59.13859648s 2026-11-01T06:19:49.999054Z info ads ADS: new connection for node:1 2026-11-01T06:19:49.999485Z info cache returned workload certificate from cache ttl=23h59m59.0005166s 2026-11-01T06:19:50.000221Z info ads ADS: new connection for node:2 2026-11-01T06:19:50.000816Z info cache returned workload trust anchor from cache ttl=23h59m58.999186536s 2026-11-01T06:19:50.078178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:57.766008Z info Readiness succeeded in 8.005078101s 2026-11-01T06:19:57.766321Z info Envoy proxy is ready [2026-11-01T06:20:04.042Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 377 82 - "44.212.242.249,10.132.0.11" "curl/7.76.1" "0a8300d9-85a3-40cf-95c5-9954f70b37db" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:41762 10.132.0.42:443 10.132.0.11:53478 - v1-model-routing 2026-11-01T06:20:07.174552Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:20:07.174576Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:20:07.174579Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:20:07.174582Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 2026-11-01T06:20:07.488092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:07.488122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:07.488140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:20:07.488144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:20:07.154Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 20 - "44.212.242.249,10.132.0.11" "curl/7.76.1" "080cbbb4-1d99-4022-b5ab-227847e1fd45" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:53502 - v1-model-routing [2026-11-01T06:20:07.374Z] "DELETE /v1/api-keys/457fe1e1-8707-4701-9c46-3bec8b988390 HTTP/1.1" 200 - via_upstream - "-" 0 365 113 - "44.212.242.249,10.132.0.11" "curl/7.76.1" "71ace34f-478e-476d-820d-c0f07791d2a4" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:55358 10.132.0.42:443 10.132.0.11:53518 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:20:08.027119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:08.027154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:08.027169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:20:08.027175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:20:08.019Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 7 - "44.212.242.249,10.132.0.11" "curl/7.76.1" "28c1ff6f-3141-4a06-9f59-7828a6db317f" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:55358 10.132.0.42:443 10.132.0.11:53522 - odh-ai-gateway-infra.maas-api-route.4 2026-11-01T06:20:23.560791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:23.560824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:23.560836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:23.560840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T06:20:23.448Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 112 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "eaaa700d-fb64-49ab-9217-c20054e0704a" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:53780 10.132.0.42:443 10.132.0.11:47582 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:20:23.755Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 31 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "4f27866a-3812-4037-a590-5c00bdde0d9c" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.42:443 10.132.0.11:47586 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:20:27.431842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:27.431875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:27.431889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:20:27.431893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:20:27.323Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 108 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "8ff44b08-d4f7-4237-a3f6-676f66b841d5" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:55358 10.132.0.42:443 10.132.0.11:47602 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:20:29.382697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:29.382736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:29.382753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:20:29.382759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-01T06:20:29.268Z] "DELETE /v1/api-keys/e095e37b-d77f-4345-b516-8d37ea2990c6 HTTP/1.1" 200 - via_upstream - "-" 0 321 114 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "28d0e0eb-afd8-4195-bce3-6c578714c142" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:53780 10.132.0.42:443 10.132.0.11:47622 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:20:30.179096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:30.179128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:30.179142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:30.179146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T06:20:30.036Z] "DELETE /v1/api-keys/130ad070-a797-4d6c-8c80-99f3839bed7c HTTP/1.1" 200 - via_upstream - "-" 0 321 142 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "ad0d0ebd-26db-4075-9669-5af4cbceab01" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:55358 10.132.0.42:443 10.132.0.11:47636 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:20:31.081564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:31.081597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:31.081610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:31.081615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:20:31.548758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:31.548790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:20:31.548804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:20:31.548808Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:20:30.974Z] "DELETE /v1/api-keys/fba286de-b575-4b0d-80c2-19343ebef7f0 HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "ca5d0296-86e5-4332-8efa-d1849dadc147" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:53780 10.132.0.42:443 10.132.0.11:47638 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:20:31.432Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 116 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "908123df-1828-4b20-944d-11f356867fd9" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:55358 10.132.0.42:443 10.132.0.11:47648 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:20:32.728954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:32.728985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:32.728999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:20:32.729003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T06:20:32.625Z] "DELETE /v1/api-keys/100d9d8e-ff30-4c6d-a737-c7d28a55249c HTTP/1.1" 200 - via_upstream - "-" 0 321 103 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "cc0cb89e-0e6e-4efc-a8c0-6cccc9c691e4" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:53780 10.132.0.42:443 10.132.0.11:57304 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:20:59.024997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:04.282210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:49.773995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:22:49.774043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:22:49.774055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:22:49.774060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:22:49.774223Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-01T06:22:49.774289Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:22:49.774298Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:22:49.774300Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:22:49.774304Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T06:22:49.690Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 83 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "6be25afe-02d0-4d97-9ee0-b07f6d39de86" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:54372 10.132.0.42:443 10.132.0.11:35188 - v1-completions-path 2026-11-01T06:25:48.589836Z info ads ADS: new connection for node:3 2026-11-01T06:25:48.608327Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T06:25:48.608464Z info cache read certificate from file resource=file-root:system 2026-11-01T06:30:06.281506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:30:06.281541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:30:06.281553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:30:06.281558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:30:06.281725Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-11-01T06:30:06.281772Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T06:30:06.281779Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T06:30:06.281783Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T06:30:06.281786Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-01T06:30:06.221Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 60 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "daeb7d0d-dfa8-443f-88b1-d5c5ca401af3" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:41762 10.132.0.42:443 10.132.0.11:41622 - v1-chat-completions-path 2026-11-01T06:32:16.833704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:32:16.833759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:32:16.833784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:32:16.833790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:32:16.834054Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-01T06:32:16.834125Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:32:16.834132Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:32:16.834136Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:32:16.834141Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T06:32:16.429Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 126 129 404 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "227f4237-96b6-45fc-a4a9-d5e7f2f2d93a" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:54372 10.132.0.42:443 10.132.0.11:47678 - v1-chat-completions-path 2026-11-01T06:33:39.888811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:34.736263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:41:48.101635Z info ads ADS: new connection for node:4 2026-11-01T06:41:48.101901Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:41:48.101980Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:42:22.784261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:42:48.796597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:44:19.307583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:47:31.159409Z info ads ADS: "" 4 terminated 2026-11-01T06:48:29.038249Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T06:48:41.407997Z info ads ADS: new connection for node:5 2026-11-01T06:48:41.433173Z info cache read certificate from file resource=file-root:system 2026-11-01T06:48:46.925721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:48:55.148729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:49:07.122931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:49:24.759838Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T06:49:28.687683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:49:35.011Z] "POST /llm/e2e-dft-db62d5/anything/e2e-dft-db62d5-e733ed HTTP/1.1" 503 - - "-" 109 0 100 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "9219f58a-9743-49b8-894c-6c2e1f6356cc" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-db62d5.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:53148 - llm.external-model-e2e-dft-db62d5-5ac83e0c5255.2 2026-11-01T06:49:41.286612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:49:41.286643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:49:41.286652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:49:41.286656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:49:41.286784Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T06:49:41.221Z] "POST /llm/e2e-rt-sw-a1c5ce/anything/e2e-rt-sw-a1c5ce-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 65 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "31971751-1d22-4e27-9936-ab2cc722fba3" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-a1c5ce.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:53178 - llm.external-model-e2e-rt-sw-a1c5ce-10bee3e61750.2 2026-11-01T06:49:46.546033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:49:46.546062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:49:46.546072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:49:46.546077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:49:46.546213Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T06:49:46.482Z] "POST /llm/e2e-rt-sw-a1c5ce/anything/e2e-rt-sw-a1c5ce-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 63 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "4d0ca2a1-7ad3-4ea1-9e0f-ac2a3b719686" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-a1c5ce.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:41472 - llm.external-model-e2e-rt-sw-a1c5ce-10bee3e61750.2 [2026-11-01T06:49:56.145Z] "POST /llm/e2e-dft-db62d5/anything/e2e-dft-db62d5-e733ed HTTP/1.1" 503 - - "-" 109 0 65 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "352582bf-ccae-4c86-841f-8846bd15c322" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-db62d5.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:40666 - llm.external-model-e2e-dft-db62d5-5ac83e0c5255.2 2026-11-01T06:50:26.006415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:50:46.157989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:50:55.206868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-01T06:50:55.140Z] "POST /llm/e2e-rt-eq-9fd337/anything/e2e-rt-eq-9fd337-client HTTP/1.1" 503 - - "-" 124 0 66 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "f32c9518-e1fb-4b98-900b-4d06cf79091f" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-9fd337.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:37084 - llm.external-model-e2e-rt-eq-9fd337-1131ea7ea208.4 2026-11-01T06:51:13.258875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:52:00.555404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T06:52:00.541Z] "POST /llm/e2e-rt-eq-9fd337/anything/e2e-rt-eq-9fd337-client HTTP/1.1" 503 - - "-" 124 0 90 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "490f287d-35c3-441a-95e2-f4e56d2a1074" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-9fd337.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:51798 - llm.external-model-e2e-rt-eq-9fd337-1131ea7ea208.4 [2026-11-01T06:53:36.158Z] "POST /llm/e2e-rt-eq-9fd337/anything/e2e-rt-eq-9fd337-client HTTP/1.1" 503 - - "-" 124 0 60 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "dc739cb6-2e97-43aa-a830-e79c9ad43624" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-9fd337.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:39902 - llm.external-model-e2e-rt-eq-9fd337-1131ea7ea208.4 2026-11-01T06:54:51.543877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:54:54.243077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:55:05.644851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:29.533006Z info ads ADS: "" 5 terminated 2026-11-01T07:07:29.623485Z info ads ADS: new connection for node:6 2026-11-01T07:07:29.627508Z info cache read certificate from file resource=file-root:system 2026-11-01T07:07:30.366925Z info ads ADS: "" 6 terminated 2026-11-01T07:07:35.825389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:55.987561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:35.823607Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-01T07:09:44.364964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:33.684806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:59.968854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:49.921415Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T07:18:49.921436Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T07:18:49.921439Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T07:18:49.921443Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-01T07:18:49.877Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 43 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "551d7f4a-b92e-4534-b66f-d5a0164139ef" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:55146 - v1-completions-path 2026-11-01T07:19:11.530738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:15.188031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:19:15.188156Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:19:15.188188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T07:19:15.188195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-01T07:19:15.062Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 125 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "4af7a12c-8352-4192-b5e6-75925f5142ae" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:45858 10.132.0.42:443 10.132.0.11:41668 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:19:31.328382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:38.279519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:58.888096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:20:06.391393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:20:29.116721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:20:59.497880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:10.483045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:21.443579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:32.437430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:43.590065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:54.323054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:57.144717Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-01T07:22:05.085617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:22:16.021731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:22:26.621366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:22:37.322269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:33.103763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:52.082185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:56.716616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:05.710245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:18.553445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:27.486378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:43.974774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:55.691671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:58.176133Z info ads ADS: new connection for node:7 2026-11-01T07:25:58.176301Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T07:25:58.176329Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T07:26:00.697893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:46.820583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:26:52.286Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 329 88 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "7164e07e-9e1f-4c4e-815e-67a4a93d0557" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.134.0.173:8000" outbound|54321||e2e-prio-pool-7a816b61-inference-pool-ip-c35c702e.llm.svc.cluster.local 10.132.0.42:43028 10.132.0.42:443 10.132.0.11:46546 - v1-model-routing [2026-11-01T07:27:08.390Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 36 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "62d7c011-8aa5-4482-bcde-80ac54aa6e8d" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-7a816b61-inference-pool-ip-c35c702e.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:51360 - v1-model-routing 2026-11-01T07:27:10.463230Z info ads ADS: "" 7 terminated with stream closed 2026-11-01T07:27:10.753502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:15.548978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:29.999317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:40.764724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:28:08.743736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:28:40.262632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:28:56.237195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:29:08.862220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:29:21.530474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:29:26.319505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:29:32.285895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:29:32.285942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:29:32.285955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:29:32.285960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T07:29:32.220Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 65 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "1305bc4a-05ea-4ae9-a3e1-40f2eb25ca1d" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:49082 10.132.0.42:443 10.132.0.11:41126 - v1-catch-all-path 2026-11-01T07:29:45.948050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:30:28.703Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 66 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "f2154f5b-92c5-4470-a66f-345bae95683a" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:54372 10.132.0.42:443 10.132.0.11:48718 - v1-completions-path 2026-11-01T07:30:30.409908Z info ads ADS: new connection for node:8 2026-11-01T07:30:30.414520Z info cache read certificate from file resource=file-root:system 2026-11-01T07:30:34.249468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:30:35.305180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:31:35.394545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:31:35.394574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:31:35.394584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T07:31:35.394587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:31:35.394735Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T07:31:35.272Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 122 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "595fe670-dda6-46b4-9c66-2ef1497222c8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.42:37868 10.132.0.42:443 10.132.0.11:59546 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T07:32:10.275359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:32:10.275393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:32:10.275409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T07:32:10.275415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:32:10.275599Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T07:32:10.153Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 121 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "d008c374-aaed-4dc5-8f77-1b192e59d393" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.42:50526 10.132.0.42:443 10.132.0.11:47160 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T07:32:27.886499Z info ads ADS: "" 8 terminated 2026-11-01T07:32:27.935252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:32:30.517696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:32:41.005629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:32:45.142Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "ebd2fa3e-f6f6-480e-8a93-da945f8f36b3" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:36744 - v1-completions-path 2026-11-01T07:32:59.111063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:33:16.001456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:33:25.384Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "9dc6a451-2bfd-4b91-8955-f958d0ffde3b" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:58086 - v1-completions-path [2026-11-01T07:33:28.162Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "a01ff4a9-355d-4ad1-9b30-a7e08da0a9ac" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:58090 - v1-completions-path 2026-11-01T07:33:46.842753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:33:57.453554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:34:03.594214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:34:16.293Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "83b27599-61fe-438f-9650-12937d33704d" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:57168 - v1-completions-path [2026-11-01T07:34:16.552Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "2d8e9d1e-18e4-4bb5-b598-6e7e2dd3a7a9" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:57174 - v1-completions-path 2026-11-01T07:34:32.235470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:34:36.856034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:34:49.944235Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:34:58.529175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:35:07.599641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:35:13.855310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:35:27.097Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 60 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "5d9b39ff-5dd8-4204-9897-92e79a964fe7" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:54372 10.132.0.42:443 10.132.0.11:51678 - v1-completions-path 2026-11-01T07:35:28.201327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:35:42.415088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:36:05.393Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 38 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "ff0ddfab-790b-473c-b2ce-01d7aee00513" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:44006 - v1-completions-path 2026-11-01T07:36:11.984899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:36:33.403217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:36:44.016924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:39:58.554Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 50 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "85f062f5-b6d0-4238-a12b-51deb890a38b" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:37618 - v1-completions-path 2026-11-01T07:40:07.661471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:40:16.648165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:40:37.482073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:40:42.241595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:41:01.921529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:41:12.706903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:41:18.790850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:41:29.236027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:41:29.236062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:41:29.236075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T07:41:29.236080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-01T07:41:29.123Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 112 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "c06d1692-1725-456f-a156-7a8ac07a6c6a" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.134.0.177:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:41182 10.132.0.42:443 10.132.0.11:49804 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T07:41:29.427Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "a117b802-c267-4889-884f-a0292fcb27b4" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:49808 - v1-completions-path [2026-11-01T07:41:29.683Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 52 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "20566dfb-950b-447d-9068-bac2c58f4479" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:49812 - v1-completions-path [2026-11-01T07:41:29.930Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "ebac6dc3-7b9d-4251-b562-182fbcb341a1" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:49082 10.132.0.42:443 10.132.0.11:49826 - v1-completions-path [2026-11-01T07:41:30.336Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 71 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "e973b0c6-a2aa-4a66-83e0-5700526468ee" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:49840 - v1-completions-path 2026-11-01T07:41:32.066842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:41:32.066876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:41:32.066890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:41:32.066895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T07:41:31.958Z] "DELETE /v1/api-keys/5f58df36-2a50-42cd-baee-8f467ae14174 HTTP/1.1" 200 - via_upstream - "-" 0 365 108 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "dbb52ef4-d87b-4350-a60f-48523ac85240" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.134.0.177:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:58876 10.132.0.42:443 10.132.0.11:32848 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:41:45.966038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:41:52.252950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:41:58.335453Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:42:06.790424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:42:06.790459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:42:06.790473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:42:06.790478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T07:42:06.665Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 125 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "f368d6e3-271c-434c-8497-600e03a91623" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.196:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:33774 10.132.0.42:443 10.132.0.11:45888 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T07:42:07.549Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "8018409d-7a5f-4ed6-898e-6a8f2eec7b2f" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:49082 10.132.0.42:443 10.132.0.11:45910 - v1-completions-path [2026-11-01T07:42:08.912Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "296d62c6-1076-4bf3-ab25-5d22ad9b6d7d" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:49082 10.132.0.42:443 10.132.0.11:45918 - v1-completions-path [2026-11-01T07:42:16.121Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "49b730cc-dc67-4593-a424-6ef0e5634141" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:35862 10.132.0.42:443 10.132.0.11:48218 - v1-completions-path [2026-11-01T07:42:16.473Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 54 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "a9699101-2511-4170-89cb-aaf1cdad216c" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.42:443 10.132.0.11:48226 - v1-completions-path 2026-11-01T07:42:30.699167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:42:41.392913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:42:47.924624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:42:53.741312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:43:06.138929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:43:29.420488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:43:38.998529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:43:38.998568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:43:38.998582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:43:38.998588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T07:43:38.881Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 117 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "26f11083-72e3-4831-bb1b-4dd5fa8dabb2" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.134.0.177:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.42:58638 10.132.0.42:443 10.132.0.11:33426 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:43:40.086208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:43:46.817Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 65 - "44.212.242.249,10.132.0.11" "python-requests/2.33.0" "e7af75bb-b47b-4a23-8117-9f6066eeab05" "maas.apps.e6f4510bf418d82e9118.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.42:54372 10.132.0.42:443 10.132.0.11:55558 - v1-completions-path