2026-10-30T16:31:58.218335Z info FLAG: --concurrency="0" 2026-10-30T16:31:58.218367Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T16:31:58.218371Z info FLAG: --help="false" 2026-10-30T16:31:58.218374Z info FLAG: --log_as_json="false" 2026-10-30T16:31:58.218376Z info FLAG: --log_caller="" 2026-10-30T16:31:58.218377Z info FLAG: --log_output_level="default:info" 2026-10-30T16:31:58.218379Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T16:31:58.218383Z info FLAG: --log_target="[stdout]" 2026-10-30T16:31:58.218386Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T16:31:58.218387Z info FLAG: --outlierLogPath="" 2026-10-30T16:31:58.218389Z info FLAG: --profiling="true" 2026-10-30T16:31:58.218391Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T16:31:58.218393Z info FLAG: --proxyLogLevel="warning" 2026-10-30T16:31:58.218395Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T16:31:58.218397Z info FLAG: --stsPort="0" 2026-10-30T16:31:58.218399Z info FLAG: --templateFile="" 2026-10-30T16:31:58.218401Z info FLAG: --tokenManagerPlugin="" 2026-10-30T16:31:58.218403Z info FLAG: --vklog="0" 2026-10-30T16:31:58.218406Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T16:31:58.218545Z info Proxy role ips=[10.132.0.53] type=router id=maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T16:31:58.218601Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T16:31:58.219920Z info cpu limit detected as 2, setting concurrency 2026-10-30T16:31:58.220206Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T16:31:58.220219Z info JWT policy is third-party-jwt 2026-10-30T16:31:58.220223Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T16:31:58.221804Z info Starting default Istio SDS Server 2026-10-30T16:31:58.221827Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T16:31:58.221867Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T16:31:58.222423Z info Opening status port 15020 2026-10-30T16:31:58.223767Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T16:31:58.224019Z info sds Starting SDS grpc server 2026-10-30T16:31:58.224072Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T16:31:58.225047Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T16:31:58.225870Z info Starting proxy agent 2026-10-30T16:31:58.225898Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T16:31:58.290090Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T16:31:58.306421Z info cache generated new workload certificate resourceName=default latency=82.249236ms ttl=23h59m59.693582958s 2026-10-30T16:31:58.306459Z info cache Root cert has changed, start rotating root cert 2026-10-30T16:31:58.306493Z info cache returned workload trust anchor from cache ttl=23h59m59.693508016s 2026-10-30T16:31:58.402956Z info ads ADS: new connection for node:1 2026-10-30T16:31:58.403160Z info cache returned workload certificate from cache ttl=23h59m59.596841779s 2026-10-30T16:31:58.403453Z info ads ADS: new connection for node:2 2026-10-30T16:31:58.403686Z info cache returned workload trust anchor from cache ttl=23h59m59.596316029s 2026-10-30T16:31:58.483225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:32:06.071077Z info Readiness succeeded in 7.855403221s 2026-10-30T16:32:06.071543Z info Envoy proxy is ready [2026-10-30T16:32:30.604Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 61 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "b1dfe777-016d-449c-bc3b-803965c7b075" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.53:443 10.132.0.21:44980 - v1-model-routing 2026-10-30T16:34:51.090056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:51.090091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:51.090105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:51.090109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:34:51.782001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:51.782033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:51.782046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:51.782051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T16:34:50.870Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 220 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "3242b92c-3bb5-45ca-a372-4f14da02fb73" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:34784 10.132.0.53:443 10.132.0.21:38558 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:34:51.698Z] "DELETE /v1/api-keys/7ec05d38-185d-44b6-bd78-932c851484a9 HTTP/1.1" 200 - via_upstream - "-" 0 321 83 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "0fdd24e4-fbc9-4f06-8db6-88050970366a" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:34784 10.132.0.53:443 10.132.0.21:38568 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:34:52.482965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:34:52.483002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:34:52.483016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:34:52.483021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T16:34:52.371Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 111 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "956cd408-c3f1-4033-a5e4-3d4f24afbe1f" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:34792 10.132.0.53:443 10.132.0.21:38582 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:34:53.375933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:53.375980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:53.376002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:53.376009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:34:53.970125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:34:53.970162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:34:53.970180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:34:53.970187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T16:34:53.296Z] "DELETE /v1/api-keys/9ce102f2-432f-4149-a94a-4307f3f50c1d HTTP/1.1" 200 - via_upstream - "-" 0 321 79 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "86a2206b-19e9-4e2e-b689-d94ee4821fb2" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:34784 10.132.0.53:443 10.132.0.21:38588 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:34:53.875Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 95 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "9c563749-9b1c-47f3-b3d6-a6189157e3a6" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:34792 10.132.0.53:443 10.132.0.21:38596 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:34:55.175505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:55.175577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:34:55.175614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T16:34:55.175627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T16:34:55.043Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 132 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "4b71eb13-2d8e-4c32-8709-7e31649d719b" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:34784 10.132.0.53:443 10.132.0.21:38602 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:34:58.669607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T16:34:58.593Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 77 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "16984199-3bda-4719-a80a-4410c6ee59ce" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:34396 10.132.0.53:443 10.132.0.21:38606 - v1-completions-path [2026-10-30T16:34:58.784Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 59 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "b6db472a-d852-4968-9912-856706d4bc05" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:34396 10.132.0.53:443 10.132.0.21:38618 - v1-completions-path [2026-10-30T16:35:03.303Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 67 - "34.228.250.194,10.132.0.21" "-" "d1b87092-ce7d-48ef-817b-1e3f50de665b" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:34396 10.132.0.53:443 10.132.0.21:45746 - v1-completions-path 2026-10-30T16:35:09.665125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:35:24.296760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:39:58.376937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:40:24.946845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:41:06.391301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:41:10.425991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:41:10.426032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:41:10.426050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T16:41:10.426057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T16:41:10.351Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 74 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "d3aafa6e-6503-407b-a0d4-fc8f217af583" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:50360 10.132.0.53:443 10.132.0.21:39022 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:41:23.418551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:41:27.720955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T16:41:31.509Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a1f7194d-c27f-4436-8149-13766924fa83" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.53:443 10.132.0.21:43868 - v1-completions-path 2026-10-30T16:41:43.499062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:41:45.836741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:41:48.924868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:41:57.841095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:42:03.377007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:42:03.377045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:42:03.377059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:42:03.377064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T16:42:03.299Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 77 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "e2aef7cb-09d2-42d1-b4b1-6695f2ba9e9c" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:35664 10.132.0.53:443 10.132.0.21:41706 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T16:42:05.955Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 69 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "353217be-d4b1-452c-a27f-2c7363d83e0c" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:58624 10.132.0.53:443 10.132.0.21:41720 - v1-completions-path 2026-10-30T16:42:21.975803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:42:32.313534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:42:36.643040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T16:42:41.606Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "7c2c7bc7-e37d-9412-92b3-2704fdeaa6b5" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:58030 10.132.0.53:443 10.132.0.21:36822 - v1-completions-path [2026-10-30T16:42:42.246Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 53 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "57353c9c-2157-49bc-b83e-29aa161d3d24" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:58030 10.132.0.53:443 10.132.0.21:36838 - v1-completions-path 2026-10-30T16:42:54.646659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:42:56.802216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:43:16.212418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:43:21.441499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:43:39.939370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T16:43:55.646Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 65 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "911d9cb9-927f-4007-be87-75af8abe9886" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:34396 10.132.0.53:443 10.132.0.21:35700 - v1-completions-path 2026-10-30T16:43:56.991194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:44:07.508898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:44:10.419444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:44:30.126618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:44:32.773477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:44:53.662898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:44:56.385267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:46:33.264267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:46:36.444914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:48:06.423258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:48:21.769969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:48:24.006999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:48:38.534377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:49:52.323830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T16:49:52.323907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:49:52.323932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:49:52.323948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T16:49:52.323954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T16:49:52.244Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 79 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "6e696a50-3f2f-4ca8-9c3c-13fdaa2500c5" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:36406 10.132.0.53:443 10.132.0.21:60858 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:49:57.488733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:50:19.357484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:50:35.251482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:50:49.423294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:50:54.020847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:51:06.470245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:51:10.000476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:51:17.558586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:51:17.558626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:51:17.558643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T16:51:17.558648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T16:51:17.496Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 525 62 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "dc40b7f4-0300-4910-9e5a-385202c2be41" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.53:50564 10.132.0.53:443 10.132.0.21:60550 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T16:51:29.850858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:51:39.773914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:51:47.961912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:51:53.466904Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T16:51:53.382Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 84 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "40745799-1a6c-4e03-b207-807b2b39a34b" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:40250 10.132.0.53:443 10.132.0.21:49906 - v1-catch-all-path 2026-10-30T16:51:53.985044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T16:51:53.978Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 54 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "9d20b57d-5275-4e4d-85b4-d2ded1356495" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.53:443 10.132.0.21:49922 - v1-catch-all-path 2026-10-30T16:52:01.291097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:52:12.711559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:52:15.506788Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T16:52:15.440Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 66 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "304a5454-5471-495c-a090-25178fa4bfab" "maas.apps.11d0492a37f0e595f7bd.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.53:56220 10.132.0.53:443 10.132.0.21:46278 - v1-catch-all-path 2026-10-30T16:52:27.490075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T16:52:38.377591Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9