2026-10-31T03:46:25.395713Z info FLAG: --concurrency="0" 2026-10-31T03:46:25.395730Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T03:46:25.395734Z info FLAG: --help="false" 2026-10-31T03:46:25.395737Z info FLAG: --log_as_json="false" 2026-10-31T03:46:25.395739Z info FLAG: --log_caller="" 2026-10-31T03:46:25.395741Z info FLAG: --log_output_level="default:info" 2026-10-31T03:46:25.395743Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T03:46:25.395748Z info FLAG: --log_target="[stdout]" 2026-10-31T03:46:25.395750Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T03:46:25.395752Z info FLAG: --outlierLogPath="" 2026-10-31T03:46:25.395754Z info FLAG: --profiling="true" 2026-10-31T03:46:25.395756Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T03:46:25.395758Z info FLAG: --proxyLogLevel="warning" 2026-10-31T03:46:25.395760Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T03:46:25.395762Z info FLAG: --stsPort="0" 2026-10-31T03:46:25.395764Z info FLAG: --templateFile="" 2026-10-31T03:46:25.395766Z info FLAG: --tokenManagerPlugin="" 2026-10-31T03:46:25.395768Z info FLAG: --vklog="0" 2026-10-31T03:46:25.395771Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T03:46:25.395964Z info Proxy role ips=[10.133.0.34] type=router id=maas-default-gateway-openshift-default-7d64fcddb7-dzxxb.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T03:46:25.396017Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T03:46:25.397031Z info cpu limit detected as 2, setting concurrency 2026-10-31T03:46:25.397222Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T03:46:25.397233Z info JWT policy is third-party-jwt 2026-10-31T03:46:25.397236Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T03:46:25.399199Z info Starting default Istio SDS Server 2026-10-31T03:46:25.399218Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T03:46:25.399235Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T03:46:25.399399Z info Opening status port 15020 2026-10-31T03:46:25.400154Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T03:46:25.400790Z info sds Starting SDS grpc server 2026-10-31T03:46:25.400823Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T03:46:25.401300Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T03:46:25.402047Z info Starting proxy agent 2026-10-31T03:46:25.402075Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T03:46:25.463752Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T03:46:25.489498Z info cache generated new workload certificate resourceName=default latency=88.611012ms ttl=23h59m59.51050528s 2026-10-31T03:46:25.489533Z info cache Root cert has changed, start rotating root cert 2026-10-31T03:46:25.489583Z info cache returned workload trust anchor from cache ttl=23h59m59.510439478s 2026-10-31T03:46:25.679603Z info ads ADS: new connection for node:1 2026-10-31T03:46:25.679661Z info cache returned workload certificate from cache ttl=23h59m59.320340762s 2026-10-31T03:46:25.679823Z info ads ADS: new connection for node:2 2026-10-31T03:46:25.679920Z info cache returned workload trust anchor from cache ttl=23h59m59.320081214s 2026-10-31T03:46:25.756854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:46:33.473470Z info Readiness succeeded in 8.080005536s 2026-10-31T03:46:33.473808Z info Envoy proxy is ready [2026-10-31T03:46:43.599Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 368 89 - "34.228.250.194,10.132.0.19" "curl/7.76.1" "8dc33962-b5b6-4b6b-8ef5-0445dee25624" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:44636 10.133.0.34:443 10.132.0.19:55898 - v1-model-routing [2026-10-31T03:46:44.168Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 68 - "34.228.250.194,10.132.0.19" "curl/7.76.1" "a30d2abb-d93b-4161-9351-3688929e5d9e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:55904 - v1-model-routing 2026-10-31T03:46:46.729537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:46:46.729588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:46:46.729602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T03:46:46.729607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T03:46:46.716Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 13 - "34.228.250.194,10.132.0.19" "curl/7.76.1" "86e2326c-b816-4256-9f66-edffa5fff126" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:50276 10.133.0.34:443 10.132.0.19:55916 - odh-ai-gateway-infra.maas-api-route.4 2026-10-31T03:52:46.651652Z info ads ADS: new connection for node:3 2026-10-31T03:52:46.658168Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T03:52:46.658215Z info cache read certificate from file resource=file-root:system 2026-10-31T03:52:49.645370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:52:53.450309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:53:18.089819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:53:21.955297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:53:21.955334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:53:21.955348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:53:21.955354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T03:53:22.366489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:53:22.366526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:53:22.366537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T03:53:22.366541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T03:53:22.366757Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T03:53:21.823Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 131 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "7f883a39-7f85-4b1f-86e4-e379ecd4d1f9" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:54044 10.133.0.34:443 10.132.0.19:56556 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T03:53:22.147Z] "POST /anything/e2e-rt-sw-5e77ac-client HTTP/1.1" 200 - via_upstream - "-" 124 1761 219 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "8034c944-5579-4986-9227-b2ee0949295e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:34810 10.133.0.34:443 10.132.0.19:56564 - llm.external-model-e2e-rt-sw-5e77ac-3d8f25c07ae0.2 2026-10-31T03:53:32.596391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:53:35.480603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:53:35.480636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:53:35.480647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:53:35.480651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T03:53:35.480821Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T03:53:35.251Z] "POST /anything/e2e-rt-sw-5e77ac-client HTTP/1.1" 200 - via_upstream - "-" 124 1769 229 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f9ced464-2768-4c92-8c6e-4c5b02ab948f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:35926 10.133.0.34:443 10.132.0.19:41914 - llm.external-model-e2e-rt-sw-5e77ac-3d8f25c07ae0.0 2026-10-31T03:53:50.770912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:54:05.464228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:54:05.464264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:54:05.464277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T03:54:05.464283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T03:54:05.464464Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T03:54:05.251Z] "POST /anything/e2e-rt-sw-5e77ac-client HTTP/1.1" 200 - via_upstream - "-" 124 1765 213 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "0f81a1db-942f-46d1-a88b-0c66dd765f37" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:52928 10.133.0.34:443 10.132.0.19:57642 - llm.external-model-e2e-rt-sw-5e77ac-3d8f25c07ae0.0 2026-10-31T03:54:19.146552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:54:39.283813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T03:54:58.879Z] "POST /llm/e2e-rt-eq-526a0f/anything/e2e-rt-eq-526a0f-client HTTP/1.1" 503 - - "-" 124 0 79 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "27ab2388-2068-4ea6-a2aa-396aae1b9fb7" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-526a0f.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:38584 - llm.external-model-e2e-rt-eq-526a0f-98e55243408b.4 [2026-10-31T03:55:09.430Z] "POST /llm/e2e-rt-eq-526a0f/anything/e2e-rt-eq-526a0f-client HTTP/1.1" 503 - - "-" 124 0 112 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "e86d9ff3-c3c9-4808-9313-5638ffae47ed" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-526a0f.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:33560 - llm.external-model-e2e-rt-eq-526a0f-98e55243408b.4 [2026-10-31T03:57:40.059Z] "POST /llm/e2e-rt-eq-526a0f/anything/e2e-rt-eq-526a0f-client HTTP/1.1" 503 - - "-" 124 0 72 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "ea39327c-6b94-4ad4-9dfd-080b1b729288" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-526a0f.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:53566 - llm.external-model-e2e-rt-eq-526a0f-98e55243408b.4 2026-10-31T03:57:52.239815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:58:18.631045Z info ads ADS: "" 3 terminated with stream closed 2026-10-31T03:58:19.741126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:58:20.893499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:58:55.705069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T03:59:55.436860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:00:08.942647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:02:52.033486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-31T04:02:51.942Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 91 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "39ebe19c-50b7-9433-98af-54d6bd2ccaaf" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.34:443 10.132.0.19:55634 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T04:03:03.885279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T04:03:03.815Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 71 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "6993a241-ead1-4a96-818b-9ac8f4333994" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:51208 10.133.0.34:443 10.132.0.19:58338 - v1-completions-path 2026-10-31T04:03:23.239794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:03:48.928413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:15:15.706375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:15:15.706407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:15:15.706421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T04:15:15.706426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T04:15:15.693Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 12 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "fd53962a-9ee3-4d52-ae5d-97d58d06b9b6" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:42728 10.133.0.34:443 10.132.0.19:40988 - odh-ai-gateway-infra.maas-api-route.4 2026-10-31T04:16:23.217957Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T04:16:33.951237Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T04:18:00.792850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:18:00.792886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T04:18:00.792903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T04:18:00.792908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T04:18:00.675Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 116 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f368fc73-22bd-4e88-818a-8b06249e9e1d" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:51808 10.133.0.34:443 10.132.0.19:52398 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T04:18:00.992Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 316 72 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "7c437fb1-ed47-49ae-9a92-6448d27540e2" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:51208 10.133.0.34:443 10.132.0.19:52424 - v1-chat-completions-path 2026-10-31T04:18:04.897052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:18:04.897087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:18:04.897102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:18:04.897106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:18:04.897269Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-31T04:18:04.897321Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T04:18:04.897329Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T04:18:04.897332Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T04:18:04.897335Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T04:18:04.818Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 78 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f33fefb6-be11-46e6-8638-a13d9f874a5c" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:44636 10.133.0.34:443 10.132.0.19:52440 - v1-chat-completions-path [2026-10-31T04:30:50.141Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 8 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "01cbd44b-b24b-4062-b8e7-1e8e9541395c" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.34:443 10.132.0.19:47810 - - 2026-10-31T04:38:43.595992Z info ads ADS: new connection for node:4 2026-10-31T04:38:43.605463Z info cache read certificate from file resource=file-root:system 2026-10-31T04:38:47.690352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:39:17.014146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:39:26.481671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:26.481704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:26.481719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:39:26.481723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:26.912750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:26.912779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:26.912788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:26.912793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:39:26.912950Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T04:39:26.299Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 182 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "d56234ab-4f5f-40c4-a6bc-f904b62bed5a" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:53774 10.133.0.34:443 10.132.0.19:56026 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T04:39:26.690Z] "POST /anything/e2e-dft-c73bf1-2aa1cd HTTP/1.1" 200 - via_upstream - "-" 109 1783 222 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "eebff019-ac58-4acd-9169-b8ed15e5a09e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:37114 10.133.0.34:443 10.132.0.19:56030 - llm.external-model-e2e-dft-c73bf1-fa2ccadeb64e.0 2026-10-31T04:39:27.748069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:27.748099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:27.748108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T04:39:27.748112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T04:39:27.748254Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T04:39:27.528Z] "POST /anything/e2e-dft-c73bf1-2aa1cd HTTP/1.1" 200 - via_upstream - "-" 109 1781 219 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "6bc85a9b-17dc-4a09-9f59-5606e66f34cd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:37118 10.133.0.34:443 10.132.0.19:56046 - llm.external-model-e2e-dft-c73bf1-fa2ccadeb64e.0 2026-10-31T04:40:01.560887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:41:06.128436Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T04:41:50.970Z] "POST /llm/e2e-dft-2aba65/anything/e2e-dft-2aba65-78fe49 HTTP/1.1" 503 - - "-" 109 0 76 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "968bc804-f675-417c-a873-baefe2551f0e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-2aba65.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:52326 - llm.external-model-e2e-dft-2aba65-93a593d749dc.2 [2026-10-31T04:42:28.204Z] "POST /llm/e2e-dft-2aba65/anything/e2e-dft-2aba65-78fe49 HTTP/1.1" 503 - - "-" 109 0 70 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "d76dac02-de0d-4e65-bde0-d13bb9e6275e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-2aba65.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:46888 - llm.external-model-e2e-dft-2aba65-93a593d749dc.2 [2026-10-31T04:42:49.559Z] "POST /llm/e2e-dft-2aba65/anything/e2e-dft-2aba65-78fe49 HTTP/1.1" 503 - - "-" 109 0 97 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "6b68cf6f-da7e-452c-b043-608084573d76" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-2aba65.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:38126 - llm.external-model-e2e-dft-2aba65-93a593d749dc.2 [2026-10-31T04:44:20.023Z] "POST /llm/e2e-dft-2aba65/anything/e2e-dft-2aba65-78fe49 HTTP/1.1" 503 - - "-" 109 0 66 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "bc7376aa-7569-44d1-b841-8daa17639b03" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-2aba65.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:41674 - llm.external-model-e2e-dft-2aba65-93a593d749dc.2 [2026-10-31T04:45:02.454Z] "POST /llm/e2e-dft-2aba65/anything/e2e-dft-2aba65-78fe49 HTTP/1.1" 503 - - "-" 109 0 86 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "8b1fe422-d65d-4a00-b749-96e802fb02b8" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-2aba65.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:40392 - llm.external-model-e2e-dft-2aba65-93a593d749dc.2 [2026-10-31T04:45:13.010Z] "POST /llm/e2e-dft-2aba65/anything/e2e-dft-2aba65-78fe49 HTTP/1.1" 503 - - "-" 109 0 76 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "bcab1315-2c10-4d37-aa11-cbaadbb923ab" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-2aba65.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:53464 - llm.external-model-e2e-dft-2aba65-93a593d749dc.2 2026-10-31T04:46:29.703494Z info ads ADS: "" 4 terminated 2026-10-31T04:46:30.719673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:46:44.720998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:46:55.439242Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-10-31T04:47:27.394611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:48:54.679421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T04:49:35.293113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:04:46.889548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:04:46.889603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:04:46.889617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T05:04:46.889622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T05:04:46.712Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 177 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "ffba90d6-f7b0-41e4-beb2-9b27a7f0ef94" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:38940 10.133.0.34:443 10.132.0.19:45156 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:04:52.186622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:04:52.186656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:04:52.186671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T05:04:52.186675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T05:04:52.072Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 113 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "1b65def4-1e4b-4e17-abe9-95ec0f9fc9c1" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:38940 10.133.0.34:443 10.132.0.19:44914 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:04:52.868734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:05:16.900210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:05:53.388681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:05:56.571097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:05:56.571131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:05:56.571145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T05:05:56.571150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T05:05:56.454Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 304 116 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "81a4dc26-c1ea-480b-8532-c8e474e24bec" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:53782 10.133.0.34:443 10.132.0.19:36352 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T05:05:57.377Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 307 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "7f81292e-ab88-413d-865d-bfba2159390e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:48306 10.133.0.34:443 10.132.0.19:36360 - v1-chat-completions-path [2026-10-31T05:05:58.321Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 330 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "d10269c9-c9ef-4ba7-b8a1-ddc6e7f86165" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:52454 10.133.0.34:443 10.132.0.19:36370 - v1-chat-completions-path [2026-10-31T05:05:59.025Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 60 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "6cc9eb77-1b8b-4013-8ee9-4083c16b6319" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:48306 10.133.0.34:443 10.132.0.19:53462 - v1-chat-completions-path [2026-10-31T05:05:59.278Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 60 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "21c11c2e-2448-4df4-910b-7c9811d0e7de" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:48306 10.133.0.34:443 10.132.0.19:53474 - v1-chat-completions-path 2026-10-31T05:06:12.991887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:17.728174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:19.677005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:06:19.677055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:06:19.677078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:06:19.677086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T05:06:19.557Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 119 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "5610611f-c8c0-4e91-bfdb-4f54b991e91f" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:53782 10.133.0.34:443 10.132.0.19:41196 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:06:19.962108Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T05:06:19.886Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 75 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "eacaf5d7-2e07-4fbe-908a-f939d274712c" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:59186 10.133.0.34:443 10.132.0.19:41210 - v1-catch-all-path 2026-10-31T05:06:26.739816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:29.177481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:06:29.177516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:06:29.177531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T05:06:29.177535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:06:29.481724Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-31T05:06:29.049Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 127 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "b83d2cc7-ebe5-4a75-abcf-a8aab68b9d3e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:53782 10.133.0.34:443 10.132.0.19:41242 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T05:06:29.390Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 91 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "2a2e0316-bfef-4d1d-9ba2-ab736da924b8" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:39034 10.133.0.34:443 10.132.0.19:48510 - v1-catch-all-path 2026-10-31T05:06:29.861557Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T05:06:29.772Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 88 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "d2a5b107-fa59-4d1d-89bb-4a8860f58eff" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:59186 10.133.0.34:443 10.132.0.19:48518 - v1-catch-all-path 2026-10-31T05:06:31.794064Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-31T05:06:31.706Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 87 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "591abab1-e8ad-4713-9360-1d6f329a9e5f" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:39034 10.133.0.34:443 10.132.0.19:48540 - v1-catch-all-path 2026-10-31T05:06:39.857399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:50.360488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:07:07.272773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:07:18.927063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:07:22.473141Z info ads ADS: new connection for node:5 2026-10-31T05:07:22.473299Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T05:07:22.473346Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T05:07:25.803021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:08:10.500405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:08:35.321176Z info ads ADS: "" 5 terminated 2026-10-31T05:08:35.365968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:08:40.435Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 60 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "a1762af6-5a32-43db-85f7-4401f9c4f484" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:51208 10.133.0.34:443 10.132.0.19:34022 - v1-completions-path 2026-10-31T05:08:41.833748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:08:54.767245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:11:32.017437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:11:59.714548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:12:36.229258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:12:51.394320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:12:58.706272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:12:58.706308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:12:58.706321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:12:58.706326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T05:12:58.585Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 120 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "e5ba8a27-3d27-4617-bd6b-d379b6f053f0" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:37320 10.133.0.34:443 10.132.0.19:58252 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:13:00.212368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:13:13.324116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:13:17.739367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:13:22.579115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:13:22.579152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:13:22.579168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:13:22.579173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T05:13:22.526Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 53 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "17ed8587-02ae-47c6-846b-b9dc8394f0f4" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:37320 10.133.0.34:443 10.132.0.19:38922 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:13:36.057206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:15:58.741012Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=5 [2026-10-31T05:16:29.005Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 67 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "3df9ffe0-87c2-4470-b233-00be18febc57" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:44636 10.133.0.34:443 10.132.0.19:51554 - v1-completions-path [2026-10-31T05:16:58.812Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 72 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "7891fe11-e52a-4a0a-ab95-d99fabfac20e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:51208 10.133.0.34:443 10.132.0.19:54888 - v1-completions-path 2026-10-31T05:17:00.594741Z info ads ADS: new connection for node:6 2026-10-31T05:17:00.598038Z info cache read certificate from file resource=file-root:system 2026-10-31T05:17:04.347351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:17:05.733961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:17:37.548942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:17:37.548971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:17:37.548980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T05:17:37.548984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:17:37.549120Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T05:17:37.353Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 195 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "248bd2b7-8972-40f7-8e1a-79e9fa55e529" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:45512 10.133.0.34:443 10.132.0.19:59982 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T05:17:51.818452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:17:51.818481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:17:51.818490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:17:51.818494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T05:17:51.818671Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T05:17:51.688Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 129 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "e56e2b11-8766-43af-991c-4a3a44fc354c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:45512 10.133.0.34:443 10.132.0.19:32810 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T05:17:54.217427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:17:54.217458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:17:54.217469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:17:54.217473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:17:54.217656Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T05:17:54.024Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 193 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "cc4d8176-1e90-4250-8f63-869e88d679b6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:52994 10.133.0.34:443 10.132.0.19:32828 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T05:18:08.459532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:18:08.459578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:18:08.459589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:18:08.459594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:18:08.459744Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T05:18:08.330Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 129 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "25911f57-9f68-4df7-b703-653d10bfea6b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.34:52994 10.133.0.34:443 10.132.0.19:58470 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T05:18:35.627211Z info ads ADS: "" 6 terminated 2026-10-31T05:18:35.681142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:18:36.024071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:18:36.024108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:18:36.024124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:18:36.024129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T05:18:35.906Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 117 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "d2e17269-db8f-460f-b2ee-04325e6c9214" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:49748 10.133.0.34:443 10.132.0.19:42790 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:18:38.697411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:18:48.248114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:19:07.114382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:19:11.817957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:19:14.816Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 77 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f85b5526-9c9a-420e-8d8a-20e68194c4b6" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:42712 10.133.0.34:443 10.132.0.19:58474 - v1-completions-path 2026-10-31T05:19:28.322015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:19:45.206410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:19:57.766Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 66 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "0c2a2e2b-e9e9-4ad0-8471-c07724e9e8e3" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:40902 10.133.0.34:443 10.132.0.19:35024 - v1-completions-path 2026-10-31T05:20:16.316352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:27.052929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:33.282746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:20:45.515Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "ae62b1ba-9cb4-484d-beef-db12ffb8c06d" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:42712 10.133.0.34:443 10.132.0.19:44236 - v1-completions-path [2026-10-31T05:20:46.123Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f75dc8f7-866f-4db2-9563-e61fd3c6f44b" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:42712 10.133.0.34:443 10.132.0.19:44256 - v1-completions-path [2026-10-31T05:20:46.632Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "100c2879-42a1-42c5-8909-cc01c0a73e89" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:42712 10.133.0.34:443 10.132.0.19:44260 - v1-completions-path 2026-10-31T05:21:01.922520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:06.612896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:19.915732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:26.187000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:40.836701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:45.280002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:57.073765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:12.317500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:18.627189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:38.631354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:22:43.572Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 61 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "e9f8b077-3ed2-413b-aef0-6eb64643bd66" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:50364 - v1-completions-path 2026-10-31T05:22:44.129422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:46.463700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:22:46.463731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:22:46.463745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:22:46.463750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T05:22:46.350Z] "DELETE /v1/api-keys/3ebcc9bc-c921-4e08-ac8f-09034903fa54 HTTP/1.1" 404 - via_upstream - "-" 0 29 113 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "53f13280-38cd-4416-b2f9-e15cd2590fae" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:56498 10.133.0.34:443 10.132.0.19:50382 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:22:55.251763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:23:19.545734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:23:29.161719Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-31T05:23:30.286484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:23:49.918645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:23:57.461749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:26:22.897546Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:27:52.866213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:12.572547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:17.841904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:31.543718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:45.287813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:50.666260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:53.231861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:28:53.231900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:28:53.231919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:28:53.231926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T05:28:52.980Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 250 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "4152dde8-88cc-42a2-b462-ba8f7a73a820" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.1.8:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:60696 10.133.0.34:443 10.132.0.19:46918 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T05:28:55.410Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "c2d2d5e0-0009-4c24-9e3c-bb317f3afa30" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:42712 10.133.0.34:443 10.132.0.19:46930 - v1-completions-path 2026-10-31T05:29:10.369094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:29:21.085384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:29:27.667626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:29:41.663Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "c8b4b155-265c-4363-a007-d8a209835740" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:42712 10.133.0.34:443 10.132.0.19:54774 - v1-completions-path 2026-10-31T05:29:57.066753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:03.789133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:10.116895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:30:19.031Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "c2332ab9-12e7-4f49-a5a4-e5680356d990" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:42712 10.133.0.34:443 10.132.0.19:41658 - v1-completions-path [2026-10-31T05:30:23.618Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "5710eb12-286d-484c-887c-e9baaa468164" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:40902 10.133.0.34:443 10.132.0.19:41672 - v1-completions-path [2026-10-31T05:30:27.284Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "ac1296c9-1a09-4895-b787-4963483e4fa0" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:40902 10.133.0.34:443 10.132.0.19:41682 - v1-completions-path 2026-10-31T05:30:28.024200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:30:28.024235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:30:28.024251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:30:28.024256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T05:30:27.635Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 62 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "80ea62d0-0b31-45d8-bddd-2a106b2208f5" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.34:443 10.132.0.19:41690 - v1-completions-path [2026-10-31T05:30:27.902Z] "DELETE /v1/api-keys/2657940e-4a35-4ac1-aafe-98da87af9b70 HTTP/1.1" 200 - via_upstream - "-" 0 363 121 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "14b9233a-25ad-4de3-acb7-22784ed22a8e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.233:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:58438 10.133.0.34:443 10.132.0.19:41702 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:30:42.036094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:52.535761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:59.463918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:05.838980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:13.589337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:31:13.589372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:31:13.589388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:31:13.589393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T05:31:13.473Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 116 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "e640d120-ef2a-4e11-a4c8-7a207366b18c" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.233:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.34:58438 10.133.0.34:443 10.132.0.19:49896 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:31:17.916772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:31:24.255Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "3b95bb74-0a89-49d6-a7e6-1419f20fb2b2" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:42712 10.133.0.34:443 10.132.0.19:52878 - v1-completions-path 2026-10-31T05:31:40.778922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:51.580030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:56.789920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:12.818428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:19.221191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:24.552200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:48.273529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:59.386237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:33:19.260854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:33:30.283092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:33:41.213050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:33:52.135870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:02.732656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:13.478468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:24.329136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:35.242561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:45.719696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:34:47.253Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 210 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "6faa387f-846e-429e-9070-e169bd25c62e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:44636 10.133.0.34:443 10.132.0.19:50800 - v1-completions-path