2026-11-04T03:29:33.444394Z info FLAG: --concurrency="0" 2026-11-04T03:29:33.444414Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T03:29:33.444419Z info FLAG: --help="false" 2026-11-04T03:29:33.444421Z info FLAG: --log_as_json="false" 2026-11-04T03:29:33.444423Z info FLAG: --log_caller="" 2026-11-04T03:29:33.444425Z info FLAG: --log_output_level="default:info" 2026-11-04T03:29:33.444427Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T03:29:33.444435Z info FLAG: --log_target="[stdout]" 2026-11-04T03:29:33.444438Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T03:29:33.444440Z info FLAG: --outlierLogPath="" 2026-11-04T03:29:33.444442Z info FLAG: --profiling="true" 2026-11-04T03:29:33.444444Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T03:29:33.444446Z info FLAG: --proxyLogLevel="warning" 2026-11-04T03:29:33.444448Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T03:29:33.444450Z info FLAG: --stsPort="0" 2026-11-04T03:29:33.444451Z info FLAG: --templateFile="" 2026-11-04T03:29:33.444453Z info FLAG: --tokenManagerPlugin="" 2026-11-04T03:29:33.444456Z info FLAG: --vklog="0" 2026-11-04T03:29:33.444459Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T03:29:33.444597Z info Proxy role ips=[10.134.0.43] type=router id=maas-default-gateway-openshift-default-8b64f9ff9-st9jq.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T03:29:33.444639Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T03:29:33.445636Z info cpu limit detected as 2, setting concurrency 2026-11-04T03:29:33.445908Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T03:29:33.445919Z info JWT policy is third-party-jwt 2026-11-04T03:29:33.445922Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T03:29:33.447639Z info Starting default Istio SDS Server 2026-11-04T03:29:33.447659Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T03:29:33.447677Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T03:29:33.448071Z info Opening status port 15020 2026-11-04T03:29:33.448917Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T03:29:33.449884Z info sds Starting SDS grpc server 2026-11-04T03:29:33.449900Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T03:29:33.450500Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T03:29:33.451488Z info Starting proxy agent 2026-11-04T03:29:33.451518Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T03:29:33.514589Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T03:29:33.633339Z info cache generated new workload certificate resourceName=default latency=183.310064ms ttl=23h59m59.366664523s 2026-11-04T03:29:33.633373Z info cache Root cert has changed, start rotating root cert 2026-11-04T03:29:33.633406Z info cache returned workload trust anchor from cache ttl=23h59m59.366594364s 2026-11-04T03:29:33.663486Z info ads ADS: new connection for node:1 2026-11-04T03:29:33.663564Z info cache returned workload trust anchor from cache ttl=23h59m59.336437669s 2026-11-04T03:29:33.663663Z info ads ADS: new connection for node:2 2026-11-04T03:29:33.663716Z info cache returned workload certificate from cache ttl=23h59m59.336285273s 2026-11-04T03:29:33.747345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:29:41.936079Z info Readiness succeeded in 8.493979922s 2026-11-04T03:29:41.936385Z info Envoy proxy is ready [2026-11-04T03:30:17.127Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 431 84 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "3e7fe688-0d68-4a96-b529-ed75f6900acd" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.43:54148 10.134.0.43:443 10.132.0.14:35048 - v1-model-routing [2026-11-04T03:30:18.741Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 61 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "69f41b82-4c59-4b77-a336-8596447ce78f" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.43:443 10.132.0.14:35056 - v1-model-routing 2026-11-04T03:30:20.416234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:20.416269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:20.416281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:20.416286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:30:20.726301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:20.726335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:20.726349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:30:20.726353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:30:20.403Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 13 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "1c4805fa-3ff3-44be-92fa-d92f1f2b6507" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:58032 10.134.0.43:443 10.132.0.14:35062 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-04T03:30:20.624Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 102 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "0437ab2f-7038-4a16-abfb-0e9bb590aca0" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:58032 10.134.0.43:443 10.132.0.14:35076 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:00.271411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:00.271446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:00.271459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:00.271464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:35:00.569231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:00.569262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:00.569274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:00.569279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:35:00.164Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 106 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b3373824-7083-4256-af6d-81a31a5046d2" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:34138 10.134.0.43:443 10.132.0.14:36670 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:00.461Z] "DELETE /v1/api-keys/a62db853-8832-4aa9-b915-249b85cbfe60 HTTP/1.1" 200 - via_upstream - "-" 0 321 107 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "80a53d96-85c8-479f-81a0-92c6cf4abab5" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:34138 10.134.0.43:443 10.132.0.14:36674 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:01.571Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 86 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "eeb1b637-a81b-4889-9880-d8113b286833" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.43:443 10.132.0.14:36680 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:04.527577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:04.527611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:04.527624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:35:04.527628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T03:35:04.423Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 104 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0ad14455-6b5b-46b4-afbb-b8ef3b2b2151" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:34138 10.134.0.43:443 10.132.0.14:47216 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:05.035Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 87 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "332d071b-1ff2-466e-88c2-be7ad658e149" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.43:443 10.132.0.14:47234 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:06.336587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:06.336621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:06.336633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:06.336638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:35:06.861102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-04T03:35:06.227Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 109 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "998e5b74-a1c2-4d19-8dea-3f1e84bdfa7a" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:54768 10.134.0.43:443 10.132.0.14:47238 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:07.284439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:07.284473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:07.284485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:35:07.284490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:35:06.855Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 93 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "4303b92e-980b-4c68-ba48-62dbb77624bd" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.43:443 10.132.0.14:47246 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:07.166Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 117 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "060904d3-1561-41fb-97f1-3d71c6bfca3c" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:54768 10.134.0.43:443 10.132.0.14:47254 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:08.070728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:08.070761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:08.070773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:35:08.070778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:08.629938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:08.629969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:08.629976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-04T03:35:08.629987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:35:08.629991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:35:07.964Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 105 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "81ea78c8-b8d2-408b-8d24-e32da67e42bf" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:34138 10.134.0.43:443 10.132.0.14:47258 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:08.513Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 116 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "4d1daed5-9846-44fe-a993-d8f6cc9e2534" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:54768 10.134.0.43:443 10.132.0.14:47262 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:14.610066Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T03:35:14.610089Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T03:35:14.610092Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T03:35:14.610096Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-04T03:35:14.573Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 36 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "320f993a-8da6-47cd-ab35-ca95544a2640" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.43:443 10.132.0.14:40680 - v1-completions-path [2026-11-04T03:35:14.973Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 8 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "617887ac-c02f-4bd2-87c7-cf62ab43c7e7" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.43:443 10.132.0.14:40690 - - 2026-11-04T03:35:15.959030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:15.959081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:15.959106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:15.959115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:35:16.446466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:16.446502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:16.446517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:16.446522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:35:15.951Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 8 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "8f96802b-4c32-45a4-bf03-1d5b177559e9" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:54768 10.134.0.43:443 10.132.0.14:40702 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-04T03:35:16.336Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 110 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "e7adb0b1-b8ff-48b0-ad5e-019500512064" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:34138 10.134.0.43:443 10.132.0.14:40706 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:20.389Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 78 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "65917625-ee3a-4701-9c0e-f1ed2e2d107f" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.43:47344 10.134.0.43:443 10.132.0.14:40730 - v1-completions-path [2026-11-04T03:35:20.673Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 67 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "7ef006d5-1e5b-4653-8603-a4c8488d4f2e" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.43:47344 10.134.0.43:443 10.132.0.14:40746 - v1-completions-path 2026-11-04T03:35:22.260191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:22.260228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:22.260243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:22.260248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:35:22.154Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 105 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "e96e6ce9-ee17-41a1-8c20-14b1a4a67f89" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:34138 10.134.0.43:443 10.132.0.14:40762 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:23.406639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:23.406674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:23.406688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:23.406692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:35:23.406877Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-04T03:35:23.406928Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T03:35:23.406936Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T03:35:23.406940Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T03:35:23.406943Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-04T03:35:23.345Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 61 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "32b3d956-45c0-4137-9b00-5d7e4bbf1e0d" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.43:47344 10.134.0.43:443 10.132.0.14:40778 - v1-completions-path 2026-11-04T03:35:30.213078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:30.213121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:30.213141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:30.213148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:35:30.104Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 109 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "46ea8d6b-89d4-499b-8f4f-229a0a1d6ee9" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:34138 10.134.0.43:443 10.132.0.14:50426 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:38:15.407103Z info ads ADS: new connection for node:3 2026-11-04T03:38:15.412206Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T03:38:15.412259Z info cache read certificate from file resource=file-root:system 2026-11-04T03:38:22.441172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:38:31.237250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:38:57.025750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:39:07.151863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:39:07.151910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:39:07.151928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:39:07.151934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:39:07.152233Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T03:39:06.932Z] "POST /anything/e2e-dft-cb51dc-ab1dc8 HTTP/1.1" 200 - via_upstream - "-" 109 1587 219 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "57937f87-da2e-4ada-80a3-10f01c2ed8e5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.43:52680 10.134.0.43:443 10.132.0.14:47010 - llm.external-model-e2e-dft-cb51dc-b9dfb12bf3ee.0 2026-11-04T03:39:38.478866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:40:39.007421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:43:07.461038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:43:32.160493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:43:52.970608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T03:43:53.584Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 101 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "45d21509-991b-4347-bf66-cc692dd44abb" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.134.0.43:443 10.132.0.14:43578 - llm.external-model-e2e-dft-515cbb-943242308994.2 2026-11-04T03:44:08.684782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T03:44:30.885Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 66 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5bda5a61-2437-4e8a-bd2c-acd0bce32493" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.134.0.43:443 10.132.0.14:38924 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:47:36.595Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 69 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "35c92427-187c-4a9a-bf55-80ad7ee21a2a" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.134.0.43:443 10.132.0.14:40880 - llm.external-model-e2e-dft-515cbb-943242308994.2 2026-11-04T03:49:04.413187Z info ads ADS: "" 3 terminated with stream closed 2026-11-04T03:49:05.628257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:49:10.033688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8