2026-11-03T21:39:01.589928Z info FLAG: --concurrency="0" 2026-11-03T21:39:01.589947Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T21:39:01.589951Z info FLAG: --help="false" 2026-11-03T21:39:01.589954Z info FLAG: --log_as_json="false" 2026-11-03T21:39:01.589956Z info FLAG: --log_caller="" 2026-11-03T21:39:01.589958Z info FLAG: --log_output_level="default:info" 2026-11-03T21:39:01.589960Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T21:39:01.589964Z info FLAG: --log_target="[stdout]" 2026-11-03T21:39:01.589967Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T21:39:01.589969Z info FLAG: --outlierLogPath="" 2026-11-03T21:39:01.589971Z info FLAG: --profiling="true" 2026-11-03T21:39:01.589973Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T21:39:01.589975Z info FLAG: --proxyLogLevel="warning" 2026-11-03T21:39:01.589977Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T21:39:01.589979Z info FLAG: --stsPort="0" 2026-11-03T21:39:01.589981Z info FLAG: --templateFile="" 2026-11-03T21:39:01.589983Z info FLAG: --tokenManagerPlugin="" 2026-11-03T21:39:01.589986Z info FLAG: --vklog="0" 2026-11-03T21:39:01.589988Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T21:39:01.590146Z info Proxy role ips=[10.134.0.39] type=router id=maas-default-gateway-openshift-default-75d7c785f-f49qd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T21:39:01.590190Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T21:39:01.591662Z info cpu limit detected as 2, setting concurrency 2026-11-03T21:39:01.591857Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T21:39:01.591867Z info JWT policy is third-party-jwt 2026-11-03T21:39:01.591870Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T21:39:01.593563Z info Starting default Istio SDS Server 2026-11-03T21:39:01.593595Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T21:39:01.593612Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T21:39:01.593719Z info Opening status port 15020 2026-11-03T21:39:01.594796Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T21:39:01.596001Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T21:39:01.597027Z info Starting proxy agent 2026-11-03T21:39:01.597069Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T21:39:01.606142Z info sds Starting SDS grpc server 2026-11-03T21:39:01.606169Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T21:39:01.660639Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T21:39:01.733547Z info cache generated new workload certificate resourceName=default latency=138.460567ms ttl=23h59m59.266458101s 2026-11-03T21:39:01.733587Z info cache Root cert has changed, start rotating root cert 2026-11-03T21:39:01.733618Z info cache returned workload trust anchor from cache ttl=23h59m59.266382534s 2026-11-03T21:39:01.756730Z info ads ADS: new connection for node:1 2026-11-03T21:39:01.756793Z info cache returned workload certificate from cache ttl=23h59m59.243208746s 2026-11-03T21:39:01.757141Z info ads ADS: new connection for node:2 2026-11-03T21:39:01.757218Z info cache returned workload trust anchor from cache ttl=23h59m59.242782742s 2026-11-03T21:39:01.799412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:08.212849Z info Readiness succeeded in 6.625196994s 2026-11-03T21:39:08.213139Z info Envoy proxy is ready 2026-11-03T21:39:27.297281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:29.399616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:35.006483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:37.731818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:39.618290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:42.043613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:45.953913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:40:11.804144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:40:18.640794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:40:19.792993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:44:06.106658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:06.106704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:06.106721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:06.106729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T21:44:06.030Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 76 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "958ea03d-1005-4bdf-b0e3-b81a270ba986" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.39:60980 10.134.0.39:443 10.132.0.9:39246 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:44:06.394211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:06.394244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:06.394257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:44:06.394262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:07.292939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:07.292972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:07.292985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:07.292990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T21:44:06.323Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 70 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "c5bdf591-9257-424f-aca1-2e86d50dcaca" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.39:60980 10.134.0.39:443 10.132.0.9:39254 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:44:07.221Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 71 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "51a9311e-697d-4fef-9d7c-1e98f304192e" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.39:60980 10.134.0.39:443 10.132.0.9:39258 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:44:07.695615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:07.695647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:07.695660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:44:07.695665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:44:07.919207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:07.919242Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:44:07.919255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T21:44:07.919260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T21:44:07.630Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 65 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3d64c011-f117-4a4e-98e5-ed23f1382ae0" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.39:60980 10.134.0.39:443 10.132.0.9:39282 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:44:07.834Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 85 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "b63f1d37-b529-462a-b9db-133173fafa9b" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.39:60984 10.134.0.39:443 10.132.0.9:39296 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:44:26.392207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:44:29.935Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 128 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "9f268178-8b5d-461b-bdb0-b623ffa37741" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.39:443 10.132.0.9:56526 - - 2026-11-03T21:44:43.222644Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:21.841414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:49:45.778481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:50:27.965919Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:50:27.965947Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:50:27.965950Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:50:27.965955Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T21:50:27.923Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 42 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "e5502522-be28-4458-8bd4-5c9b15766bad" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.39:443 10.132.0.9:44286 - v1-completions-path 2026-11-03T21:50:35.681379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:50:40.417764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T21:50:40.160Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 74 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "7dd2b383-ba45-445d-addc-22cba5cde904" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48680 10.134.0.39:443 10.132.0.9:37770 - v1-completions-path [2026-11-03T21:50:40.359Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "190e7eb0-1914-416a-b1dc-196083d81911" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48694 10.134.0.39:443 10.132.0.9:37780 - v1-completions-path 2026-11-03T21:50:52.736496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:50:57.488803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:51:15.226Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 76 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "72c26875-9636-4360-9c5d-3f20cde54fdf" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:39780 10.134.0.39:443 10.132.0.9:44610 - v1-completions-path 2026-11-03T21:51:16.010237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:51:32.042943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:51:42.862074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:51:42.862107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:51:42.862120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:51:42.862125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T21:51:42.790Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 72 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "753e705f-4507-48a6-8686-1bcf837f9d21" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.39:52176 10.134.0.39:443 10.132.0.9:60278 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T21:51:43.216Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "3ee6e175-9c12-4a2c-8b23-a4359a09b423" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48680 10.134.0.39:443 10.132.0.9:60294 - v1-completions-path 2026-11-03T21:51:44.036100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T21:51:44.030Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "8cac952d-1a82-4fb8-adb5-e5963b4445b9" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48680 10.134.0.39:443 10.132.0.9:60302 - v1-completions-path [2026-11-03T21:51:44.289Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "aa68cc2b-e095-4532-9970-6ce5136f57d5" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48694 10.134.0.39:443 10.132.0.9:60316 - v1-completions-path [2026-11-03T21:51:44.364Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 56 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "99b4e8c3-b8db-46eb-a6fe-d72358f35d79" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48694 10.134.0.39:443 10.132.0.9:60322 - v1-completions-path [2026-11-03T21:51:44.438Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "0fb9098d-4208-45ec-8f37-52da0353aa80" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48694 10.134.0.39:443 10.132.0.9:60336 - v1-completions-path 2026-11-03T21:52:01.059788Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:52:11.536176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:52:15.972529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:52:22.770Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "33a9abdc-d873-4fa6-971d-5bc0cad8c98c" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48680 10.134.0.39:443 10.132.0.9:36650 - v1-completions-path [2026-11-03T21:52:23.967Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 59 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "fd3f2454-8ab4-4e15-a36a-f546d1cdc637" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48680 10.134.0.39:443 10.132.0.9:36662 - v1-completions-path 2026-11-03T21:52:35.985565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:52:38.380201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:52:56.728865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:53:01.152720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:53:19.941407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:53:22.339904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:53:39.978759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:01.582379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:05.436377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:24.887901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:27.906155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:54:33.650Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 67 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "bd412a54-2900-49ba-9d61-a846693e2219" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:39780 10.134.0.39:443 10.132.0.9:35306 - v1-completions-path 2026-11-03T21:54:40.663314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:54:46.239368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:54:46.239402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:54:46.239415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:54:46.239440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T21:54:46.171Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 67 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "90ae07b2-eeac-49c4-8019-750824fb4d11" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.39:57880 10.134.0.39:443 10.132.0.9:46484 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:54:58.527682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:55:08.854099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:55:28.880686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:55:32.468150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:57:12.304Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 44 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "f4f4f5d9-7913-47ff-b6fd-f3ff29d416c5" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.39:443 10.132.0.9:57316 - v1-completions-path 2026-11-03T21:57:14.623146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:57:18.218656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:58:28.977057Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:58:28.977082Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:58:28.977086Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:58:28.977089Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T21:58:28.933Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 43 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "ae5f4357-7a0e-4f7c-a6ed-f973370b0375" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.39:443 10.132.0.9:56194 - v1-completions-path 2026-11-03T21:58:47.604609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:59:02.958753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:59:05.482244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:59:24.117125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:00:59.310640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:00:59.310674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:00:59.310685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T22:00:59.310690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T22:00:59.243Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 67 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "0ded21ba-664d-4391-9537-4186e26b2010" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.39:47414 10.134.0.39:443 10.132.0.9:58946 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T22:01:05.287003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:01:20.880828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:01:36.625712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:01:50.574181Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:01:56.021087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:02:10.596592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:02:24.106977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T22:02:28.663Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "819c1235-2f65-462c-8383-717c25c8b052" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:48694 10.134.0.39:443 10.132.0.9:41282 - v1-completions-path 2026-11-03T22:02:40.931547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:05:42.180305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:05:50.296544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:06:08.228158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:06:10.640688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:06:13.714722Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 2026-11-03T22:06:13.908263Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 [2026-11-03T22:06:13.631Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 83 - "52.71.36.72,10.132.0.9" "python-requests/2.34.2" "0e1d0d67-d76f-4792-a99c-e23d9ee2560c" "maas.apps.e5da32866d8da802ebec.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.39:32936 10.134.0.39:443 10.132.0.9:52582 - v1-catch-all-path 2026-11-03T22:06:25.752411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T22:06:36.602083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8