2026-11-04T01:11:31.383294Z info FLAG: --concurrency="0" 2026-11-04T01:11:31.383312Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:11:31.383316Z info FLAG: --help="false" 2026-11-04T01:11:31.383318Z info FLAG: --log_as_json="false" 2026-11-04T01:11:31.383320Z info FLAG: --log_caller="" 2026-11-04T01:11:31.383322Z info FLAG: --log_output_level="default:info" 2026-11-04T01:11:31.383324Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:11:31.383329Z info FLAG: --log_target="[stdout]" 2026-11-04T01:11:31.383332Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:11:31.383334Z info FLAG: --outlierLogPath="" 2026-11-04T01:11:31.383336Z info FLAG: --profiling="true" 2026-11-04T01:11:31.383338Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:11:31.383340Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:11:31.383342Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:11:31.383344Z info FLAG: --stsPort="0" 2026-11-04T01:11:31.383346Z info FLAG: --templateFile="" 2026-11-04T01:11:31.383348Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:11:31.383350Z info FLAG: --vklog="0" 2026-11-04T01:11:31.383353Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:11:31.383491Z info Proxy role ips=[10.132.0.49] type=router id=maas-default-gateway-openshift-default-848f6bf8bc-mdxsf.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:11:31.383541Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:11:31.384984Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:11:31.385204Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:11:31.385217Z info JWT policy is third-party-jwt 2026-11-04T01:11:31.385222Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:11:31.387297Z info Opening status port 15020 2026-11-04T01:11:31.387632Z info Starting default Istio SDS Server 2026-11-04T01:11:31.387673Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:11:31.387705Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:11:31.388430Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:11:31.389683Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:11:31.390428Z info Starting proxy agent 2026-11-04T01:11:31.390467Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:11:31.399555Z info sds Starting SDS grpc server 2026-11-04T01:11:31.399579Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:11:31.456890Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:11:31.475056Z info cache generated new workload certificate resourceName=default latency=86.401206ms ttl=23h59m59.524947788s 2026-11-04T01:11:31.475091Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:11:31.475126Z info cache returned workload trust anchor from cache ttl=23h59m59.524874357s 2026-11-04T01:11:31.565915Z info ads ADS: new connection for node:1 2026-11-04T01:11:31.565989Z info cache returned workload certificate from cache ttl=23h59m59.434013828s 2026-11-04T01:11:31.566066Z info ads ADS: new connection for node:2 2026-11-04T01:11:31.566135Z info cache returned workload trust anchor from cache ttl=23h59m59.433866495s 2026-11-04T01:11:31.652877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:11:39.814922Z info Readiness succeeded in 8.434015744s 2026-11-04T01:11:39.815495Z info Envoy proxy is ready [2026-11-04T01:12:05.457Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 323 86 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "27ae092d-7d05-44e2-a486-37016229f993" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:47748 10.132.0.49:443 10.132.0.10:33176 - v1-model-routing 2026-11-04T01:12:07.054235Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:12:07.054261Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:12:07.054264Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:12:07.054268Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-04T01:12:07.034Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 20 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "1c4b5d3a-f5ac-479d-8f73-0e9eca9dc8b5" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.10:37910 - v1-model-routing 2026-11-04T01:14:31.548428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:14:31.548462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:14:31.548474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:14:31.548479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:14:31.465Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 82 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "94927597-4885-4718-b9f6-841ae82511e7" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:39930 10.132.0.49:443 10.132.0.10:53198 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:14:32.059464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:32.059497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:32.059509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:14:32.059513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:32.433840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:14:32.433875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:14:32.433890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:14:32.433896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:14:32.575059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:32.575101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:32.575118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:32.575124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:14:32.001Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 57 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "477aa3ee-caa0-48a2-9fba-d0f70dcfe300" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:39946 10.132.0.49:443 10.132.0.10:53206 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:14:32.243Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 49 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "cd9ae2d4-db94-4e79-9027-2cd55f32a4fa" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.49:443 10.132.0.10:53208 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:14:32.346Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 87 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8c2481d2-0643-427c-90ba-cc0d8296c784" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:39930 10.132.0.49:443 10.132.0.10:53216 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:14:32.492Z] "DELETE /v1/api-keys/72dec1ff-adfc-494b-aae0-a934debcedfb HTTP/1.1" 200 - via_upstream - "-" 0 321 82 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "0725d141-17ad-4288-8d87-6e04ba132a75" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:39946 10.132.0.49:443 10.132.0.10:53230 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:14:41.341037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:41.341069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:41.341080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:14:41.341085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:14:41.330Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 10 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "4322bea6-cfd9-4290-9b3a-391a9cacdeeb" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:39946 10.132.0.49:443 10.132.0.10:49578 - odh-ai-gateway-infra.maas-api-route.4 2026-11-04T01:14:48.443737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:14:52.983Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 72 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "7db1244a-7e74-475e-ba7b-0e5890cec21c" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:50214 10.132.0.49:443 10.132.0.10:58492 - v1-completions-path 2026-11-04T01:15:00.851826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:18:34.174376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:19:13.715439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:20:42.641081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:21:26.102580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:22:05.937797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:23:41.846496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:27:20.074898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:27:53.499814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:27:57.910313Z warn xdsproxy upstream terminated with unexpected error rpc error: code = Unavailable desc = error reading from server: read tcp 10.132.0.49:44198->172.31.249.200:15012: read: connection reset by peer id=1 2026-11-04T01:27:58.774967Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-04T01:34:26.320215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:50.245131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:35:01.944048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:35:01.944085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:35:01.944099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:35:01.944106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:35:01.883Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 60 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "ed5dd94d-26ae-4929-b31d-0371d31f741b" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:45364 10.132.0.49:443 10.132.0.10:45754 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:35:35.290325Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:35:35.290353Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:35:35.290356Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:35:35.290360Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-04T01:35:35.254Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 36 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "94ca70f3-0a13-4b3b-b731-a9eea5003d7d" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.49:443 10.132.0.10:32924 - v1-completions-path 2026-11-04T01:35:37.570512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:35:40.959Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 77 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "c930fab4-6d84-4aaf-861c-213c95ace1cf" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:38128 10.132.0.49:443 10.132.0.10:37246 - v1-completions-path 2026-11-04T01:35:53.548588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:35:55.209953Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:10.265250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:12.024270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:15.256579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:22.976562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:26.125528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:36:26.125563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:36:26.125576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:36:26.125584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:36:26.045Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 80 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "31fdb8e1-6ea5-44b3-9614-e9616d7c0701" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:51354 10.132.0.49:443 10.132.0.10:47482 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:36:45.028841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:55.256868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:56.975357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:37:02.717Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8e3fd5fb-03a5-4b15-ae99-5e3b57f6f664" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:38640 10.132.0.49:443 10.132.0.10:60408 - v1-completions-path [2026-11-04T01:37:03.439Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "ceb29a5e-ae93-4e1a-ab41-08a2f762f253" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:38128 10.132.0.49:443 10.132.0.10:60418 - v1-completions-path 2026-11-04T01:37:15.784037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:37:17.539165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:37:23.035685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:37:34.420918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:37:48.054510Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:37:49.715556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:37:55.143409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:38:01.782724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-04T01:38:01.723Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 64 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "377d5320-1f81-4662-8552-3140c9f6dbd5" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:50214 10.132.0.49:443 10.132.0.10:37682 - v1-completions-path 2026-11-04T01:38:13.359336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:38:16.294197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:38:28.520175Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-11-04T01:38:28.592650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:38:30.042889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:38:31.618542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:38:31.618578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:38:31.618591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:38:31.618597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:38:31.618604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-04T01:38:31.556Z] "DELETE /v1/api-keys/1db06d08-c470-47f7-b2b9-31e95b82b345 HTTP/1.1" 200 - via_upstream - "-" 0 375 62 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "587d80cb-1e25-4779-80c9-9e9364e2d488" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:54252 10.132.0.49:443 10.132.0.10:37616 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:38:35.832842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:38:50.975714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:01.206679Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:17.251033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:20.098528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:41:35.884296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:41:38.358439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:42:40.811040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:40.811075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:40.811090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:40.811096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:42:40.749Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 61 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8563ead8-f9d0-4ab7-9a8a-e2710f44654f" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:46336 10.132.0.49:443 10.132.0.10:58124 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:43:05.244524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:09.034753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:43:09.034788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:43:09.034799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:43:09.034804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:43:08.972Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 62 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "e062ee55-b97e-47a1-ba60-b2bb70c100ee" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:34276 10.132.0.49:443 10.132.0.10:48468 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:43:20.604315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:22.338113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:28.421688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:45:41.443878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:45:41.443914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:45:41.443931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:45:41.443935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:45:41.383Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 60 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "6d66c095-98e8-4721-b2b2-9e419e177296" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.132.0.47:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.49:36926 10.132.0.49:443 10.132.0.10:49934 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:45:46.103878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:02.349339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:18.002853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:29.532521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:33.631509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:41.495110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:44.405632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:47:00.132831Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:49:34.927900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:49:40.635453Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:49:44.135191Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-04T01:49:44.040Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 94 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "2154abda-6249-4942-8696-d18cdbe0ff0e" "maas.apps.1a199a81a0bfde016d54.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.49:38638 10.132.0.49:443 10.132.0.10:50228 - v1-catch-all-path 2026-11-04T01:49:56.035896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:49:57.633693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:50:12.133570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:50:22.930679Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8