2026-11-02T14:20:46.487279Z info FLAG: --concurrency="0" 2026-11-02T14:20:46.487297Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T14:20:46.487301Z info FLAG: --help="false" 2026-11-02T14:20:46.487304Z info FLAG: --log_as_json="false" 2026-11-02T14:20:46.487306Z info FLAG: --log_caller="" 2026-11-02T14:20:46.487307Z info FLAG: --log_output_level="default:info" 2026-11-02T14:20:46.487309Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T14:20:46.487314Z info FLAG: --log_target="[stdout]" 2026-11-02T14:20:46.487316Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T14:20:46.487318Z info FLAG: --outlierLogPath="" 2026-11-02T14:20:46.487320Z info FLAG: --profiling="true" 2026-11-02T14:20:46.487323Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T14:20:46.487325Z info FLAG: --proxyLogLevel="warning" 2026-11-02T14:20:46.487327Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T14:20:46.487329Z info FLAG: --stsPort="0" 2026-11-02T14:20:46.487330Z info FLAG: --templateFile="" 2026-11-02T14:20:46.487332Z info FLAG: --tokenManagerPlugin="" 2026-11-02T14:20:46.487335Z info FLAG: --vklog="0" 2026-11-02T14:20:46.487337Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T14:20:46.487563Z info Proxy role ips=[10.134.0.40] type=router id=maas-default-gateway-openshift-default-77bfb58f8c-pfqvs.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T14:20:46.487610Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T14:20:46.489010Z info cpu limit detected as 2, setting concurrency 2026-11-02T14:20:46.489222Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T14:20:46.489234Z info JWT policy is third-party-jwt 2026-11-02T14:20:46.489237Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T14:20:46.490716Z info Starting default Istio SDS Server 2026-11-02T14:20:46.490737Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T14:20:46.490755Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T14:20:46.491037Z info Opening status port 15020 2026-11-02T14:20:46.492010Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T14:20:46.492683Z info sds Starting SDS grpc server 2026-11-02T14:20:46.492718Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T14:20:46.493232Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T14:20:46.493953Z info Starting proxy agent 2026-11-02T14:20:46.493982Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T14:20:46.561372Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T14:20:46.653302Z info cache generated new workload certificate resourceName=default latency=160.514863ms ttl=23h59m59.346702666s 2026-11-02T14:20:46.653350Z info cache Root cert has changed, start rotating root cert 2026-11-02T14:20:46.653382Z info cache returned workload trust anchor from cache ttl=23h59m59.346618804s 2026-11-02T14:20:46.719457Z info ads ADS: new connection for node:1 2026-11-02T14:20:46.719515Z info cache returned workload certificate from cache ttl=23h59m59.280486563s 2026-11-02T14:20:46.719706Z info ads ADS: new connection for node:2 2026-11-02T14:20:46.719769Z info cache returned workload trust anchor from cache ttl=23h59m59.28023206s 2026-11-02T14:20:46.800237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:20:54.532234Z info Readiness succeeded in 8.047263514s 2026-11-02T14:20:54.532558Z info Envoy proxy is ready [2026-11-02T14:21:08.521Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 369 94 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "1440f494-413b-4cfd-9715-fad3ca2d97c3" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60536 10.134.0.40:443 10.132.0.22:48548 - v1-model-routing [2026-11-02T14:21:09.443Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 521 68 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "6592b4d4-1845-4cf8-94fb-1ca0ef65c7f9" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:48552 - v1-model-routing [2026-11-02T14:21:09.717Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 55 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "ce952ef7-1259-4f9c-a63c-a4e569a2372d" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:48568 - v1-model-routing [2026-11-02T14:21:09.982Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 55 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "b91af373-3ecc-41b2-b9ff-625a6a8ae85f" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:48578 - v1-model-routing 2026-11-02T14:21:11.989126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:21:11.989197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:21:11.989219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:21:11.989227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:21:11.874Z] "DELETE /v1/api-keys/e393f5f3-b53b-4f4a-9905-73cf88e831fb HTTP/1.1" 200 - via_upstream - "-" 0 365 114 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "c6f9ca65-d349-477c-9ab9-c651d28882b2" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:37976 10.134.0.40:443 10.132.0.22:48592 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:26:45.789177Z info ads ADS: new connection for node:3 2026-11-02T14:26:45.793031Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T14:26:45.793131Z info cache read certificate from file resource=file-root:system 2026-11-02T14:26:50.531521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:26:52.488432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:27:09.624774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:27:13.542955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:13.542990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:13.543002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:13.543008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:27:13.543261Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:27:13.423Z] "POST /anything/e2e-rt-sw-14712f-client HTTP/1.1" 200 - via_upstream - "-" 124 1772 119 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "86475ec5-b278-4e34-9596-7c7aa4329371" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.40:50030 10.134.0.40:443 10.132.0.22:37702 - llm.external-model-e2e-rt-sw-14712f-b9119e1b36bf.0 2026-11-02T14:27:19.998123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:19.998181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:19.998190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:27:19.998195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:19.998342Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:27:19.836Z] "POST /anything/e2e-rt-sw-14712f-client HTTP/1.1" 200 - via_upstream - "-" 124 1775 161 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "360c1b52-db34-4b15-b0d2-5b73439f72cf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.40:50042 10.134.0.40:443 10.132.0.22:37142 - llm.external-model-e2e-rt-sw-14712f-b9119e1b36bf.0 2026-11-02T14:27:21.047748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T14:27:21.047870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:21.047893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:21.047903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:27:21.047909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:21.048073Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:27:20.893Z] "POST /anything/e2e-rt-sw-14712f-client HTTP/1.1" 200 - via_upstream - "-" 124 1767 154 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "dbc12fc3-657b-42c7-87ea-789ece8dd919" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.40:50052 10.134.0.40:443 10.132.0.22:37146 - llm.external-model-e2e-rt-sw-14712f-b9119e1b36bf.0 2026-11-02T14:27:23.200973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:27:26.980144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:26.980205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:26.980215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:26.980220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:27:26.980362Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:27:26.921Z] "POST /llm/e2e-rt-sw-14712f/anything/e2e-rt-sw-14712f-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9c880875-30dd-45cd-a885-539c56eb10ad" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-14712f.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:47376 - llm.external-model-e2e-rt-sw-14712f-b9119e1b36bf.2 2026-11-02T14:27:34.690565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:27:43.648035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:43.648068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:43.648079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:27:43.648084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:27:43.648258Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T14:27:43.580Z] "POST /llm/e2e-rt-sw-14712f/anything/e2e-rt-sw-14712f-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 68 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2e12d203-6db1-490a-8854-2fc6928c9067" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-14712f.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:39758 - llm.external-model-e2e-rt-sw-14712f-b9119e1b36bf.2 2026-11-02T14:27:49.417386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:27:49.417419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:27:49.417429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:27:49.417433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:27:49.417591Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:27:49.353Z] "POST /llm/e2e-rt-sw-14712f/anything/e2e-rt-sw-14712f-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "dbb039ec-40e8-4652-9064-4dad6b400fae" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-14712f.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:33144 - llm.external-model-e2e-rt-sw-14712f-b9119e1b36bf.2 2026-11-02T14:27:55.213763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:27:55.213794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:27:55.213804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:27:55.213808Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:27:55.213949Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T14:27:55.103Z] "POST /anything/e2e-rt-sw-14712f-client HTTP/1.1" 200 - via_upstream - "-" 124 1770 110 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e93477f8-8a0d-4b3d-ac34-563e5df8917a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.40:50860 10.134.0.40:443 10.132.0.22:59506 - llm.external-model-e2e-rt-sw-14712f-b9119e1b36bf.0 2026-11-02T14:28:06.032647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:28:23.230672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:29:46.785Z] "POST /llm/e2e-rt-eq-55c37d/anything/e2e-rt-eq-55c37d-client HTTP/1.1" 503 - - "-" 124 0 280 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "0874b65d-864b-4987-8dac-f53beb5815d2" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-55c37d.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:57440 - llm.external-model-e2e-rt-eq-55c37d-38a4a2bd2b7a.4 [2026-11-02T14:30:34.944Z] "POST /llm/e2e-rt-eq-55c37d/anything/e2e-rt-eq-55c37d-client HTTP/1.1" 503 - - "-" 124 0 1205 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6d3cd47a-d968-4830-ac86-8fd4fc3b95d9" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-55c37d.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:41500 - llm.external-model-e2e-rt-eq-55c37d-38a4a2bd2b7a.4 2026-11-02T14:30:46.811797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T14:30:46.803Z] "POST /llm/e2e-rt-eq-55c37d/anything/e2e-rt-eq-55c37d-client HTTP/1.1" 503 - - "-" 124 0 72 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "5071143f-b7b7-4a17-ac2d-7b11bf0fc42a" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-55c37d.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:46666 - llm.external-model-e2e-rt-eq-55c37d-38a4a2bd2b7a.4 [2026-11-02T14:31:03.983Z] "POST /llm/e2e-rt-eq-55c37d/anything/e2e-rt-eq-55c37d-client HTTP/1.1" 503 - - "-" 124 0 152 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "0e677fbc-14af-491e-a5f1-2ef1a3f66910" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-55c37d.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:51220 - llm.external-model-e2e-rt-eq-55c37d-38a4a2bd2b7a.4 [2026-11-02T14:31:09.336Z] "POST /llm/e2e-rt-eq-55c37d/anything/e2e-rt-eq-55c37d-client HTTP/1.1" 503 - - "-" 124 0 60 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "fd9002ee-d01a-4a9f-8bef-5086f810bcf1" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-55c37d.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:51248 - llm.external-model-e2e-rt-eq-55c37d-38a4a2bd2b7a.4 [2026-11-02T14:31:20.050Z] "POST /llm/e2e-rt-eq-55c37d/anything/e2e-rt-eq-55c37d-client HTTP/1.1" 503 - - "-" 124 0 88 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9b41e4e1-b07d-4186-8434-945c4bc67c52" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-55c37d.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:42780 - llm.external-model-e2e-rt-eq-55c37d-38a4a2bd2b7a.4 [2026-11-02T14:31:35.903Z] "POST /llm/e2e-rt-eq-55c37d/anything/e2e-rt-eq-55c37d-client HTTP/1.1" 503 - - "-" 124 0 237 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "809424b1-28d9-467c-876f-450d650ed1fd" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-55c37d.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:44670 - llm.external-model-e2e-rt-eq-55c37d-38a4a2bd2b7a.4 2026-11-02T14:32:09.397740Z info ads ADS: "" 3 terminated 2026-11-02T14:32:10.511915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:32:21.373980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:34:03.835961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:34:23.437498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:37:34.288005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:37:34.288042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:37:34.288058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:37:34.288063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T14:37:34.105Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 182 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "bccfa0f8-c3c9-4e71-9344-83ab7402bd35" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:45448 10.134.0.40:443 10.132.0.22:58202 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:37:36.349524Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:37:36.349550Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:37:36.349553Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:37:36.349556Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T14:37:36.314Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 35 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "bd018599-dcef-4b5d-8f14-86baabcc7648" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:58210 - v1-completions-path 2026-11-02T14:37:45.749854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:37:45.749890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:37:45.749904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:37:45.749909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:37:45.632Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 117 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "164c687d-064a-4caf-bb4c-aee1cafecfd4" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:35350 10.134.0.40:443 10.132.0.22:46504 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:39:13.687Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 92 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "46888a45-ce5f-46fa-b605-9725afc87794" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:59936 - v1-completions-path 2026-11-02T14:49:01.374873Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T14:52:01.194332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:01.194370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:01.194384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T14:52:01.194388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:01.610281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:01.610317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:01.610334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:52:01.610339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T14:52:01.182Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 11 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "b0c7b29a-3195-4e98-bb0e-bee32ff9a734" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:42226 10.134.0.40:443 10.132.0.22:56582 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-02T14:52:01.495Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 114 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6724638e-64a1-4736-80dd-d424064f9327" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:42238 10.134.0.40:443 10.132.0.22:56598 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:52:01.946226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:01.946260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:01.946276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:52:01.946281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:02.885469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:02.885504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:02.885516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:52:02.885520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:02.885660Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-02T14:52:02.885702Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:52:02.885710Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:52:02.885712Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:52:02.885715Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T14:52:01.822Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 328 123 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "5e42ed51-a8ab-4e65-90eb-d704538403e0" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:42238 10.134.0.40:443 10.132.0.22:56612 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:52:02.163Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 367 78 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "343ccaeb-23a6-4b8b-b7f9-806289cc559b" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:56616 - v1-chat-completions-path [2026-11-02T14:52:02.545Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 4623 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "f647ae94-c633-402c-87cb-0c062a7af7c5" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60536 10.134.0.40:443 10.132.0.22:56622 - v1-chat-completions-path [2026-11-02T14:52:02.817Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 68 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "4bfe1390-ae8f-4fca-848a-acb3781ed428" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:56630 - v1-completions-path 2026-11-02T14:52:32.901785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:32.901826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:32.901845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:52:32.901851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:52:32.750Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 151 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "523ddff6-cda1-4132-8b73-c51a23cd5fef" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:42226 10.134.0.40:443 10.132.0.22:54716 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:52:33.712864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:33.712899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:33.712911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:52:33.712915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:52:33.713056Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-02T14:52:33.713097Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:52:33.713105Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:52:33.713107Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:52:33.713111Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T14:52:33.103Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 319 75 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "640dbee0-7911-4b31-86ec-1d05ee4ce6b3" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:54722 - v1-chat-completions-path [2026-11-02T14:52:33.379Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 329 60 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "22f0444a-8334-41a2-b1e6-30569460796f" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:54736 - v1-chat-completions-path [2026-11-02T14:52:33.651Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 126 129 61 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d047f66b-8b54-4d58-9fde-3b463e3c0ced" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:54746 - v1-chat-completions-path 2026-11-02T14:53:34.949489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:53:34.949552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:53:34.949588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:53:34.949599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T14:53:34.835Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 114 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "495ebcd4-d5d3-477e-a183-cbba3fc2fd23" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:33358 10.134.0.40:443 10.132.0.22:58068 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T14:53:35.162Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 319 70 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "742f1716-b199-466c-82f2-431c04a0215c" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:58076 - v1-chat-completions-path [2026-11-02T14:53:35.434Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 331 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "fbd0fccd-7de5-48f5-b17d-40b871412968" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60536 10.134.0.40:443 10.132.0.22:58086 - v1-chat-completions-path 2026-11-02T14:53:39.064938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:53:39.064972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:53:39.064984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T14:53:39.064988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T14:53:39.065127Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-02T14:53:39.065185Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:53:39.065194Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:53:39.065196Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T14:53:39.065200Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T14:53:38.990Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 74 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "03c16f89-2c6b-4845-bd3b-5fbbbbdd9a07" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:60544 10.134.0.40:443 10.132.0.22:58088 - v1-chat-completions-path [2026-11-02T14:53:42.352Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 22 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "8a457404-9563-4baf-a14a-573f88715502" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.40:443 10.132.0.22:58090 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:06:33.243Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 9 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "48a6099f-1b30-4f44-be28-3a34c3e80f0d" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.40:443 10.132.0.22:39346 - - 2026-11-02T15:12:35.940527Z info ads ADS: new connection for node:4 2026-11-02T15:12:35.945542Z info cache read certificate from file resource=file-root:system 2026-11-02T15:12:40.693760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:12:49.755038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:21.712771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:13:33.505342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:13:33.505377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:13:33.505390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:13:33.505395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:13:33.319Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 186 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c466f87a-0662-4a48-b750-c2ea02e37ded" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:44086 10.134.0.40:443 10.132.0.22:42020 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:13:33.876636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:13:33.876667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:13:33.876680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:13:33.876685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:13:33.876851Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:13:33.726Z] "POST /anything/e2e-dft-0cf949-15cd4e HTTP/1.1" 200 - via_upstream - "-" 109 1785 150 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "3b856be2-8cee-42c9-aca9-e5a2e0503f93" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.40:51608 10.134.0.40:443 10.132.0.22:59838 - llm.external-model-e2e-dft-0cf949-1df2add4cb56.0 2026-11-02T15:14:11.511587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:15:18.028049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:15:51.696Z] "POST /llm/e2e-dft-aa6d73/anything/e2e-dft-aa6d73-8d69ad HTTP/1.1" 503 - - "-" 109 0 72 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d92fcc14-4207-43b7-9615-3924fa3d9508" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-aa6d73.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:53212 - llm.external-model-e2e-dft-aa6d73-70a2e3ad49ad.2 [2026-11-02T15:16:55.597Z] "POST /llm/e2e-dft-aa6d73/anything/e2e-dft-aa6d73-8d69ad HTTP/1.1" 503 - - "-" 109 0 70 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6d6b5802-9d20-485d-82f1-2a68c9707cbd" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-aa6d73.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:42968 - llm.external-model-e2e-dft-aa6d73-70a2e3ad49ad.2 [2026-11-02T15:18:41.804Z] "POST /llm/e2e-dft-aa6d73/anything/e2e-dft-aa6d73-8d69ad HTTP/1.1" 503 - - "-" 109 0 67 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "1c774a4b-4cc4-4bdc-8d98-78d22b012452" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-aa6d73.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:42798 - llm.external-model-e2e-dft-aa6d73-70a2e3ad49ad.2 [2026-11-02T15:18:57.656Z] "POST /llm/e2e-dft-aa6d73/anything/e2e-dft-aa6d73-8d69ad HTTP/1.1" 503 - - "-" 109 0 232 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d0cd4cab-3001-437d-94ca-c1025c18a552" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-aa6d73.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:44538 - llm.external-model-e2e-dft-aa6d73-70a2e3ad49ad.2 [2026-11-02T15:19:40.408Z] "POST /llm/e2e-dft-aa6d73/anything/e2e-dft-aa6d73-8d69ad HTTP/1.1" 503 - - "-" 109 0 106 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d9122a6c-b98e-4a73-b55e-4fccb35fe743" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-aa6d73.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:52204 - llm.external-model-e2e-dft-aa6d73-70a2e3ad49ad.2 [2026-11-02T15:19:45.717Z] "POST /llm/e2e-dft-aa6d73/anything/e2e-dft-aa6d73-8d69ad HTTP/1.1" 503 - - "-" 109 0 74 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2fed9ce4-e81b-4e15-8998-bae882e57876" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-aa6d73.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:37026 - llm.external-model-e2e-dft-aa6d73-70a2e3ad49ad.2 [2026-11-02T15:20:22.838Z] "POST /llm/e2e-dft-aa6d73/anything/e2e-dft-aa6d73-8d69ad HTTP/1.1" 503 - - "-" 109 0 69 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "215b7c43-d784-49ca-881d-2518aae3412a" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-aa6d73.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:42100 - llm.external-model-e2e-dft-aa6d73-70a2e3ad49ad.2 2026-11-02T15:20:45.646047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:02.336664Z info ads ADS: "" 4 terminated 2026-11-02T15:21:03.338974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:30.526194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:21:45.572249Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T15:22:31.329992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:23:01.518688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:24:04.264960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:24:33.152526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:42:50.679753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:42:50.679788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:42:50.679802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T15:42:50.679807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T15:42:50.504Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 175 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "0abc73b0-b902-4e88-8853-7bea30738107" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:34944 10.134.0.40:443 10.132.0.22:37802 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:42:56.195677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:42:56.195712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:42:56.195724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:42:56.195729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:42:56.075Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 120 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "380dc8be-49fc-4217-842d-d233ab1aa763" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:35984 10.134.0.40:443 10.132.0.22:57074 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:42:58.915436Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:43:21.937004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:43:31.292077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:43:31.292109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:43:31.292120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:43:31.292124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:43:31.184Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 108 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "624f3404-e985-4a0e-b927-4552a89974ae" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:34944 10.134.0.40:443 10.132.0.22:36434 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:43:57.409776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:44:00.756Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 74 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "87301239-91c7-4051-acec-693d5cd7bb5e" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:33758 10.134.0.40:443 10.132.0.22:53414 - v1-chat-completions-path [2026-11-02T15:44:01.764Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 60 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "31924cb5-247d-4bb5-b85e-aa30f6db3823" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:33758 10.134.0.40:443 10.132.0.22:53428 - v1-chat-completions-path 2026-11-02T15:44:14.458957Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:44:14.458981Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:44:14.458983Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-02T15:44:14.458988Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-02T15:44:14.310Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 148 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "064eda5e-2f88-484c-abd3-8ade3a68eb6e" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:53868 - v1-catch-all-path 2026-11-02T15:44:15.904730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:44:20.695026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:44:23.015865Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T15:44:22.934Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 81 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "19ab15f1-c8cc-45c3-8df4-44fd2d7a1921" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:55042 10.134.0.40:443 10.132.0.22:53902 - v1-catch-all-path 2026-11-02T15:44:24.163549Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-02T15:44:24.104Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "8ccd108b-d297-4015-a363-f0be7c6f2b25" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:55050 10.134.0.40:443 10.132.0.22:37274 - v1-catch-all-model-routing 2026-11-02T15:44:30.256950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:44:32.210885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:44:32.210921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:44:32.210935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T15:44:32.210939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:44:32.932780Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T15:44:32.081Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 129 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6c9b1acb-71b2-4f0b-a0e9-ae5604224bf1" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:54032 10.134.0.40:443 10.132.0.22:37288 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:44:32.875Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 56 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "cc617585-7b1d-4c4b-b8ab-fe2ebc3779aa" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:55042 10.134.0.40:443 10.132.0.22:37304 - v1-catch-all-path 2026-11-02T15:44:33.660362Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T15:44:33.593Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 66 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "9fa0ff11-613f-416d-899e-26e274afe61b" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:55042 10.134.0.40:443 10.132.0.22:37314 - v1-catch-all-path 2026-11-02T15:44:34.778634Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-02T15:44:34.719Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "0f80d80d-7878-49c4-8f02-ce9564934e63" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:55050 10.134.0.40:443 10.132.0.22:52880 - v1-catch-all-path 2026-11-02T15:44:35.130834Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 2026-11-02T15:44:35.865912Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T15:44:35.072Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 57 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2a731ece-5ae4-4d86-bc48-325a0ad335a5" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:55042 10.134.0.40:443 10.132.0.22:52884 - v1-catch-all-path [2026-11-02T15:44:35.801Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e8c645c2-9025-4a17-872a-6897f541580d" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:55042 10.134.0.40:443 10.132.0.22:52886 - v1-catch-all-path 2026-11-02T15:44:44.347656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:44:54.223048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:44:56.149505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:44:56.149538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:44:56.149551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:44:56.149555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T15:44:56.008Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 141 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "5a2e70f5-9cca-4748-83aa-83c6cfcca869" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:54032 10.134.0.40:443 10.132.0.22:37044 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:45:03.850585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:45:13.265972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:45:25.553404Z info ads ADS: new connection for node:5 2026-11-02T15:45:25.553540Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T15:45:25.553561Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T15:45:32.343797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:46:08.416608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:46:32.762505Z info ads ADS: "" 5 terminated 2026-11-02T15:46:33.038707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:46:37.924312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:46:55.133451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:49:09.603520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:49:09.603554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:49:09.603568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:49:09.603572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T15:49:09.474Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 129 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "cf9929ec-f471-41a3-9a8d-545e85751111" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:40698 10.134.0.40:443 10.132.0.22:47808 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T15:49:15.474043Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-11-02T15:49:28.942973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:49:58.495460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:50:28.217573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:50:42.235385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:50:51.372407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:51:03.272042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:51:08.333892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:51:26.343703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:52:15.672866Z info ads ADS: new connection for node:6 2026-11-02T15:52:15.677565Z info cache read certificate from file resource=file-root:system 2026-11-02T15:52:19.600830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:52:20.811295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:52:54.132915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:52:54.132943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:52:54.132953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:52:54.132957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T15:52:54.133088Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T15:52:54.004Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 128 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "83f558c0-b0b9-4c10-8ef7-140b8b63ed63" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.40:52110 10.134.0.40:443 10.132.0.22:42414 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:53:08.126141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:53:08.126204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:53:08.126216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T15:53:08.126219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T15:53:08.126353Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T15:53:08.019Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 106 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "94e84a48-5cb0-4dc8-b71a-96d3008d21c9" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.40:52110 10.134.0.40:443 10.132.0.22:58804 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:53:10.445877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:53:10.445905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:53:10.445915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:53:10.445918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T15:53:10.446048Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T15:53:10.320Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1727 125 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "e77de276-9a5a-4e45-8a95-7d190966edac" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.40:55944 10.134.0.40:443 10.132.0.22:58824 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T15:53:58.260858Z info ads ADS: "" 6 terminated with stream closed 2026-11-02T15:53:58.309730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:54:01.083082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:54:11.828009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:54:30.545202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:54:35.250951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:54:37.788197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:54:37.788231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:54:37.788245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T15:54:37.788249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T15:54:37.520Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 268 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "5bbd8e0a-f758-46ab-97c6-909c8d149d07" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:48122 10.134.0.40:443 10.132.0.22:54984 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T15:54:38.288Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 70 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ee8eff4d-53da-4ec0-a306-720d29b9bdcd" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:46046 10.134.0.40:443 10.132.0.22:55000 - v1-completions-path 2026-11-02T15:54:56.588877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:55:09.616484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:55:17.357Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "51832398-4d9a-462b-b581-3dd48490f1e2" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:36290 10.134.0.40:443 10.132.0.22:43800 - v1-completions-path [2026-11-02T15:55:20.304Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 56 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "0b409115-7821-45ef-bc6c-c78edcf5f436" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:46046 10.134.0.40:443 10.132.0.22:43830 - v1-completions-path [2026-11-02T15:55:22.672Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "8c59fbd0-dd4f-4f9d-b6ac-20d7263ae702" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:46046 10.134.0.40:443 10.132.0.22:43844 - v1-completions-path 2026-11-02T15:55:40.537948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:55:51.186986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:55:57.754904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T15:56:08.899Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "59a126db-f402-41ab-89ed-7536bfd63b93" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:46046 10.134.0.40:443 10.132.0.22:45286 - v1-completions-path 2026-11-02T15:56:25.997080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:56:30.845267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:56:44.409498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:56:53.841818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:57:03.415935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:57:12.790176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:57:29.368124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:57:42.470559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:58:13.857972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:58:30.607588Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-02T15:58:36.726976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T15:58:47.384681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:03:11.537757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:03:29.071803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:03:33.736533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:03:47.144525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:02.947288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:08.086070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:28.172013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:38.876819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:04:45.226775Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T16:04:59.835Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "df38b305-457a-4ef3-bf61-bfabeb27c84c" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.40:443 10.132.0.22:43332 - v1-completions-path 2026-11-02T16:05:14.517827Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:05:20.975554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:05:27.252218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:05:35.187445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:05:35.187481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:05:35.187495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T16:05:35.187499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T16:05:35.068Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 118 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "50abfe14-4593-4901-a5f8-4319506fda05" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.1.167:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:38922 10.134.0.40:443 10.132.0.22:55480 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T16:05:42.649Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "fffbbc47-0aa4-4a65-a7e7-e4336506648c" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:36290 10.134.0.40:443 10.132.0.22:55498 - v1-completions-path 2026-11-02T16:05:45.535127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:05:45.535193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:05:45.535209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T16:05:45.535214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T16:05:45.405Z] "DELETE /v1/api-keys/ed63fc6a-d541-470f-88ab-10af5605caeb HTTP/1.1" 200 - via_upstream - "-" 0 365 129 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "48c789ad-e588-48ff-b122-d9cfd6ee3b53" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.208:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:43730 10.134.0.40:443 10.132.0.22:51638 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T16:05:59.225872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:06:09.839054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:06:16.637358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:06:22.792540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:06:30.779381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:06:30.779420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:06:30.779439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T16:06:30.779446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T16:06:30.666Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 113 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d4957ce4-75ec-4242-8650-933cd4d28a8c" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.132.0.208:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.40:43730 10.134.0.40:443 10.132.0.22:38622 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T16:06:34.777573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T16:06:41.389Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "4021b858-03cf-41af-9253-46ff6b6b05bb" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:36290 10.134.0.40:443 10.132.0.22:56638 - v1-completions-path [2026-11-02T16:06:41.756Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "f9df98b1-0257-4892-8e12-8a2867b5f129" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:46046 10.134.0.40:443 10.132.0.22:56640 - v1-completions-path [2026-11-02T16:06:42.119Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ccafb752-679f-43a5-aae9-174a69f64103" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:36290 10.134.0.40:443 10.132.0.22:56642 - v1-completions-path [2026-11-02T16:06:42.478Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c8eb15f4-e51f-431f-bd34-0adcf5239ff2" "maas.apps.61d88bbb8c406d3a9034.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.40:46046 10.134.0.40:443 10.132.0.22:56658 - v1-completions-path 2026-11-02T16:06:58.062463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:07:08.833941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:07:13.860754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:07:32.320967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:07:38.586528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:08:01.881165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:08:23.930925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:08:43.742443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:08:54.771566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:09:05.650904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:09:16.513515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:09:27.161098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:09:37.955140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:09:48.778823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T16:09:59.470514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8