2026-10-30T12:54:41.245721Z info FLAG: --concurrency="0" 2026-10-30T12:54:41.245745Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T12:54:41.245752Z info FLAG: --help="false" 2026-10-30T12:54:41.245756Z info FLAG: --log_as_json="false" 2026-10-30T12:54:41.245760Z info FLAG: --log_caller="" 2026-10-30T12:54:41.245763Z info FLAG: --log_output_level="default:info" 2026-10-30T12:54:41.245766Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T12:54:41.245773Z info FLAG: --log_target="[stdout]" 2026-10-30T12:54:41.245777Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T12:54:41.245780Z info FLAG: --outlierLogPath="" 2026-10-30T12:54:41.245784Z info FLAG: --profiling="true" 2026-10-30T12:54:41.245787Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T12:54:41.245790Z info FLAG: --proxyLogLevel="warning" 2026-10-30T12:54:41.245794Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T12:54:41.245797Z info FLAG: --stsPort="0" 2026-10-30T12:54:41.245800Z info FLAG: --templateFile="" 2026-10-30T12:54:41.245803Z info FLAG: --tokenManagerPlugin="" 2026-10-30T12:54:41.245807Z info FLAG: --vklog="0" 2026-10-30T12:54:41.245811Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T12:54:41.246005Z info Proxy role ips=[10.134.0.62] type=router id=maas-default-gateway-openshift-default-68cb9b4b95-zdkqf.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T12:54:41.246073Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T12:54:41.247690Z info cpu limit detected as 2, setting concurrency 2026-10-30T12:54:41.248011Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T12:54:41.248026Z info JWT policy is third-party-jwt 2026-10-30T12:54:41.248030Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T12:54:41.250613Z info Starting default Istio SDS Server 2026-10-30T12:54:41.250638Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T12:54:41.250663Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T12:54:41.251798Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T12:54:41.254523Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T12:54:41.258056Z info Starting proxy agent 2026-10-30T12:54:41.258125Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T12:54:41.257021Z info Opening status port 15020 2026-10-30T12:54:41.259892Z info sds Starting SDS grpc server 2026-10-30T12:54:41.259949Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T12:54:41.342576Z info cache generated new workload certificate resourceName=default latency=84.679779ms ttl=23h59m59.657428482s 2026-10-30T12:54:41.342706Z info cache Root cert has changed, start rotating root cert 2026-10-30T12:54:41.342801Z info cache returned workload trust anchor from cache ttl=23h59m59.657200177s 2026-10-30T12:54:41.365307Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T12:54:41.536065Z info ads ADS: new connection for node:1 2026-10-30T12:54:41.536161Z info cache returned workload certificate from cache ttl=23h59m59.463841585s 2026-10-30T12:54:41.536604Z info ads ADS: new connection for node:2 2026-10-30T12:54:41.536696Z info cache returned workload trust anchor from cache ttl=23h59m59.463306657s 2026-10-30T12:54:41.657879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:54:49.808623Z info Readiness succeeded in 8.56761434s 2026-10-30T12:54:49.809058Z info Envoy proxy is ready 2026-10-30T12:57:34.369755Z info ads ADS: new connection for node:3 2026-10-30T12:57:34.376972Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T12:57:34.377020Z info cache read certificate from file resource=file-root:system 2026-10-30T12:57:35.561184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:42.750755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:57:51.684632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:58:01.723156Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:58:01.723190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:58:01.723201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:58:01.723205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T12:58:01.723382Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-30T12:58:01.598Z] "POST /anything/e2e-rt-sw-b88fb2-client HTTP/1.1" 200 - via_upstream - "-" 124 1766 124 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "a15af33c-92e9-4dfb-84dd-2fd42ca7c0f5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:34272 10.134.0.62:443 10.132.0.13:52562 - llm.external-model-e2e-rt-sw-b88fb2-68098a466cff.0 2026-10-30T12:58:02.886813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:58:17.607482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:58:17.607512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:58:17.607521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T12:58:17.607526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:58:17.607668Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-30T12:58:17.465Z] "POST /anything/e2e-rt-sw-b88fb2-client HTTP/1.1" 200 - via_upstream - "-" 124 1763 142 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5019f677-2753-4fe4-83c5-396eaac51a56" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:39634 10.134.0.62:443 10.132.0.13:39348 - llm.external-model-e2e-rt-sw-b88fb2-68098a466cff.0 2026-10-30T12:58:23.795478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:58:53.694863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:59:03.863376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:59:10.016677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:10.016788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:10.016833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:10.016862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T12:59:10.017200Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-30T12:59:09.846Z] "POST /anything/e2e-rt-eq-f3b60e-client HTTP/1.1" 200 - via_upstream - "-" 124 1765 170 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e8ed0bd9-9dcf-406d-9985-7e18a97ceaa2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:42118 10.134.0.62:443 10.132.0.13:44102 - llm.external-model-e2e-rt-eq-f3b60e-18b5414f7fac.2 2026-10-30T12:59:10.866486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-10-30T12:59:10.920388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:10.920420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:10.920432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T12:59:10.920436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:10.920610Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-10-30T12:59:11.091614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:11.091657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:11.091674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T12:59:11.091680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T12:59:11.091923Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-30T12:59:10.765Z] "POST /anything/e2e-rt-eq-f3b60e-client HTTP/1.1" 200 - via_upstream - "-" 124 1764 155 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "76011f3b-6d97-43d6-9ba8-12fb490d220a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:42122 10.134.0.62:443 10.132.0.13:44104 - llm.external-model-e2e-rt-eq-f3b60e-18b5414f7fac.0 [2026-10-30T12:59:10.947Z] "POST /anything/e2e-rt-eq-f3b60e-client HTTP/1.1" 200 - via_upstream - "-" 124 1765 144 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "53922871-889a-40b5-bef4-bdbf080cba4b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:42132 10.134.0.62:443 10.132.0.13:44120 - llm.external-model-e2e-rt-eq-f3b60e-18b5414f7fac.0 2026-10-30T12:59:36.129279Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T12:59:36.471946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T12:59:43.056534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:01:04.324446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:01:28.214500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:02:42.376003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:03:08.299765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:04:55.595153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:55.595198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:55.595220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T13:04:55.595226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-30T13:04:55.332Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 54 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "f3724aea-43ed-4152-b82b-f711f6eac707" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.62:443 10.132.0.13:53348 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:04:55.509Z] "DELETE /v1/api-keys/76b03af2-47f3-4757-815f-ad9821d3f35a HTTP/1.1" 200 - via_upstream - "-" 0 321 85 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ec3cc3b5-be04-4258-a2eb-c272b0083e37" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:33754 10.134.0.62:443 10.132.0.13:53350 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:04:56.151440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:56.151483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:56.151502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T13:04:56.151507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:56.649953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:56.649992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:56.650007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:56.650012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T13:04:56.077Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "d386cc84-fe60-4cbb-a745-c9d055c0f144" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:33754 10.134.0.62:443 10.132.0.13:53358 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:04:56.578Z] "DELETE /v1/api-keys/330a9441-1902-4158-896f-e2dd9e75f6cb HTTP/1.1" 200 - via_upstream - "-" 0 321 71 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1ae3278d-cef4-4aba-bfff-6bf372f80f06" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:33754 10.134.0.62:443 10.132.0.13:53364 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:04:57.336Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 49 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ba28111d-4d8f-48aa-96e3-b0194bea8b29" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.62:443 10.132.0.13:53376 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:04:57.929057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:57.929128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:57.929147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T13:04:57.929153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:58.563915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:58.563953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:04:58.563969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T13:04:58.563973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-30T13:04:57.855Z] "DELETE /v1/api-keys/0a6b846c-647e-4a6b-9340-2c3c62079c68 HTTP/1.1" 200 - via_upstream - "-" 0 321 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "3f41494a-4479-4086-96d6-8c3bb2c72404" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:33754 10.134.0.62:443 10.132.0.13:53380 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:04:58.477Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 86 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "f43194df-4de8-970e-b0f4-f3493fb3d8e0" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:33754 10.134.0.62:443 10.132.0.13:53382 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T13:05:07.012Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 78 - "52.71.36.72,10.132.0.13" "-" "0431899f-09cb-41ec-9a5b-09e5e7836b42" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:37548 10.134.0.62:443 10.132.0.13:47044 - v1-completions-path [2026-10-30T13:05:12.701Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 82 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5bcc5d69-9880-49ce-804e-96c76e8ad69e" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:37548 10.134.0.62:443 10.132.0.13:47058 - v1-completions-path [2026-10-30T13:05:13.516Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 7 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "3de72333-8c83-4621-bb26-8d32d11ef1a4" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.62:443 10.132.0.13:47060 - - 2026-10-30T13:11:52.080275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:11:52.080320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:11:52.080339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:11:52.080345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T13:11:52.080590Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-10-30T13:11:52.080658Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T13:11:52.080668Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T13:11:52.080671Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T13:11:52.080676Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-10-30T13:11:51.811Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 320 84 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "8b992fb4-2811-4f7f-b353-af647a18d5f0" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:34440 10.134.0.62:443 10.132.0.13:43710 - v1-chat-completions-path [2026-10-30T13:11:52.016Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 126 129 63 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "55f0fd4c-62d9-44d1-ba87-89e2d5c4ff1b" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:34440 10.134.0.62:443 10.132.0.13:43712 - v1-chat-completions-path 2026-10-30T13:12:04.682531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:12:04.682568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:12:04.682581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T13:12:04.682585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:12:04.892282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:12:04.892318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:12:04.892333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:12:04.892338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T13:12:04.656Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 25 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "4f241225-be66-48b8-a399-cb19434f3992" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:58688 10.134.0.62:443 10.132.0.13:54240 - odh-ai-gateway-infra.maas-api-route.4 [2026-10-30T13:12:04.815Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 77 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "b4fc00a6-1a97-4a22-8489-6fd688afc34b" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:58698 10.134.0.62:443 10.132.0.13:54254 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:23:25.730165Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T13:23:28.625671Z info ads ADS: new connection for node:4 2026-10-30T13:23:28.633955Z info cache read certificate from file resource=file-root:system 2026-10-30T13:31:11.507638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:31:37.544860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:31:40.534265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:31:40.534301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T13:31:40.534315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T13:31:40.534320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-30T13:31:40.440Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 93 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ae5f35d9-19d5-4324-876d-03c29f8104c8" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:59042 10.134.0.62:443 10.132.0.13:47312 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T13:31:41.044231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T13:31:41.093967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:31:41.093999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:31:41.094008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:31:41.094013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:31:41.094178Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T13:31:40.962Z] "POST /anything/e2e-dft-053b2a-93fa02 HTTP/1.1" 200 - via_upstream - "-" 109 1752 131 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "49493238-a7ad-475a-a8a2-47d5e600e2f2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:40530 10.134.0.62:443 10.132.0.13:47316 - llm.external-model-e2e-dft-053b2a-e0042c864acb.0 [2026-10-30T13:31:41.120Z] "POST /llm/e2e-dft-053b2a/anything/e2e-dft-053b2a-93fa02 HTTP/1.1" 401 - - "-" 109 88 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "079c5965-195d-4be4-ac25-94a915c127d7" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-053b2a.llm.svc.cluster.local - 10.134.0.62:443 10.132.0.13:47320 - llm.external-model-e2e-dft-053b2a-e0042c864acb.2 2026-10-30T13:31:53.004944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:31:56.296602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:32:01.708197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:32:09.077119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:32:14.344618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:32:17.741309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:32:18.340877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:32:39.226752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:33:27.570906Z info ads ADS: new connection for node:5 2026-10-30T13:33:27.571106Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T13:33:27.571134Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T13:36:38.647742Z info ads ADS: "" 5 terminated 2026-10-30T13:38:22.806376Z info ads ADS: "" 4 terminated 2026-10-30T13:43:31.512576Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-30T13:44:31.551988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:45:56.349562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:49:34.358553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:51:39.425630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:03.745206Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T13:55:16.429158Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-10-30T14:01:10.007274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:01:36.522129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:09.719585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:26.583653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:29.323403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:36.893217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:02:36.893252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:02:36.893266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T14:02:36.893270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:02:37.349525Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-30T14:02:36.814Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 78 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "51d915e8-8f14-46e5-8bcb-39430ea7dc43" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:33814 10.134.0.62:443 10.132.0.13:32844 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T14:02:37.278Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 71 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6afcf08d-f785-4dd7-bfb0-178eda25c698" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:46474 10.134.0.62:443 10.132.0.13:32848 - v1-catch-all-model-routing 2026-10-30T14:02:39.820412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:45.253123Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T14:02:45.190Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "db71f73a-e044-4590-9821-84862d6f1465" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:33254 10.134.0.62:443 10.132.0.13:52576 - v1-catch-all-path 2026-10-30T14:02:58.105049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:00.451740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:03.330162Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T14:03:03.265Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 65 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "66e6a0a2-87a7-4eb5-9c8f-d21493e86d59" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:33254 10.134.0.62:443 10.132.0.13:46148 - v1-catch-all-path 2026-10-30T14:03:15.358860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:26.380100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:28.053376Z info ads ADS: new connection for node:6 2026-10-30T14:03:28.053644Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T14:03:28.053732Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T14:03:30.388908Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:11.106684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:11.842791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:04:11.842827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:04:11.842841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:04:11.842846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T14:04:11.748Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 94 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7c5e158e-1308-4ef2-a552-06e004835d63" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:57328 10.134.0.62:443 10.132.0.13:48576 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T14:04:15.507Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 333 86 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "12c40d22-7669-42cb-a30e-f292fdf8cade" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.1.3:8000" outbound|54321||e2e-prio-pool-6a03d47f-inference-pool-ip-d0654a22.llm.svc.cluster.local 10.134.0.62:55274 10.134.0.62:443 10.132.0.13:38914 - v1-model-routing 2026-10-30T14:04:30.268762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:30.292295Z info ads ADS: "" 6 terminated with stream closed 2026-10-30T14:04:32.687190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:04:32.687237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:04:32.687257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:04:32.687264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T14:04:32.613Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 333 73 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "42653ceb-31a0-422d-a1db-f924a481c3af" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:57328 10.134.0.62:443 10.132.0.13:38816 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:04:33.706909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:41.700919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:15.462956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:33.634907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:46.398119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:06:46.398176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:06:46.398204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:06:46.398212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T14:06:46.342Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 55 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9c6555d4-ead5-4733-9917-99a812784e43" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:46284 10.134.0.62:443 10.132.0.13:60428 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:06:48.388267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:07:00.461227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:07:02.198365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:07:02.198406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:07:02.198424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:07:02.198430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T14:07:02.123Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "11ba3c09-1063-42bb-a3b1-9512e2a08cdc" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:43822 10.134.0.62:443 10.132.0.13:43310 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:07:04.108634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:07:14.387760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:07:18.932237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:07:37.019387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:08:23.526838Z info ads ADS: new connection for node:7 2026-10-30T14:08:23.538740Z info cache read certificate from file resource=file-root:system 2026-10-30T14:08:24.455050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:08:26.234532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:08:28.904318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:08:28.904356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:08:28.904370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:08:28.904375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T14:08:28.768Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 135 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "bb4027b9-f70f-4191-adfb-c7101821fb91" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:47394 10.134.0.62:443 10.132.0.13:47876 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:08:54.875989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:54.876031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:54.876045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:08:54.876051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:54.876284Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T14:08:54.770Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 106 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c149b043-a688-4a94-9b42-b9d94bbed39c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:37864 10.134.0.62:443 10.132.0.13:48646 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:08:56.990627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:56.990666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:56.990677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:56.990681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:08:56.990835Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T14:08:56.898Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 91 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9cdcf2c2-ff71-4fba-80d3-b1c7d1aa1706" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:37864 10.134.0.62:443 10.132.0.13:53404 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:08:59.106968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:59.107005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:59.107016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:08:59.107020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:08:59.107201Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T14:08:59.012Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 94 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "59d3731f-806a-48fa-a8c1-836dfa33e842" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:37864 10.134.0.62:443 10.132.0.13:53414 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:09:14.012635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:09:14.012673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:09:14.012684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:09:14.012688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T14:09:14.012856Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-30T14:09:13.905Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 107 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c1ab3c4f-5568-42af-9225-5bfb848388b7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:52560 10.134.0.62:443 10.132.0.13:57334 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:09:18.262264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:09:18.262298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:09:18.262310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T14:09:18.262314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:09:18.262475Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-30T14:09:18.168Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 94 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5ffb0baa-a856-410f-b6ae-305ae5ebd1bb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.62:52560 10.134.0.62:443 10.132.0.13:47724 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:09:50.891959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:09:51.000788Z info ads ADS: "" 7 terminated 2026-10-30T14:09:52.491184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:09:59.205642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:03.275345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:10:03.275384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:10:03.275398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T14:10:03.275403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T14:10:03.201Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 73 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "4e14d9c2-7806-48b6-8018-1251dd6c4617" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:53418 10.134.0.62:443 10.132.0.13:40950 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T14:10:03.489Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 70 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "92f0afcb-3602-4141-8829-218146e1c2ff" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:49512 10.134.0.62:443 10.132.0.13:40966 - v1-completions-path 2026-10-30T14:10:16.375711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:21.010373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:36.501992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:52.410125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:10:58.899Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ce0f48df-b260-4a38-bdb8-15f948f6d66d" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:57660 10.134.0.62:443 10.132.0.13:39238 - v1-completions-path 2026-10-30T14:11:16.013912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:26.368379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:31.031201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:34.612408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:11:34.612445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:11:34.612460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:11:34.612465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T14:11:34.537Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 75 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "ee00292b-7248-409c-9be3-5ffd109507ce" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:33508 10.134.0.62:443 10.132.0.13:37308 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T14:11:34.715Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 55 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "08968167-6802-4a7b-a9d2-730ecdf4a79d" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:57660 10.134.0.62:443 10.132.0.13:37320 - v1-completions-path [2026-10-30T14:11:34.791Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "d1f67d95-e9a1-40bc-bcf5-0b5ff72906a1" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:57660 10.134.0.62:443 10.132.0.13:37322 - v1-completions-path 2026-10-30T14:11:47.924601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:50.440866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:09.615310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:14.271265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:29.852706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:32.159402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:50.036800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:00.810430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:03.855485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:31.885586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:49.968941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:00.240507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:17:36.186378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:17:51.382482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:17:53.672154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:18:12.802778Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:18:25.033325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:18:27.952064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:18:28.450Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 103 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7e3bc64c-3da3-41ce-99e4-91c4449eada5" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:49512 10.134.0.62:443 10.132.0.13:44522 - v1-completions-path 2026-10-30T14:18:43.635844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:18:54.499933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:18:59.466525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:19:04.241Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "979ff1e9-e00e-408d-92d2-a22f6fe9540c" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:49512 10.134.0.62:443 10.132.0.13:35750 - v1-completions-path 2026-10-30T14:19:16.544978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:19:21.067875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:19:24.686567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:19:30.690Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c29844b9-5304-4e46-a0c7-573eea3bf3a6" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:49512 10.134.0.62:443 10.132.0.13:35080 - v1-completions-path [2026-10-30T14:19:30.782Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "f15f3640-57cd-4573-b19f-e393156f35c6" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:57660 10.134.0.62:443 10.132.0.13:35096 - v1-completions-path [2026-10-30T14:19:33.884Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 55 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "d3427846-5fd2-4199-a030-d8141a373739" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:57660 10.134.0.62:443 10.132.0.13:35104 - v1-completions-path [2026-10-30T14:19:34.060Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9582e66c-63b2-4259-985c-c64ce0c1e5fb" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.132.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.62:57660 10.134.0.62:443 10.132.0.13:35110 - v1-completions-path 2026-10-30T14:19:47.393748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:19:57.761463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:20:02.375739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:20:05.968399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:20:10.647707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:20:29.139408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:20:39.429839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:20:41.701507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:20:51.388704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:20:55.007988Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:21:13.374004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:21:33.369573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:21:43.779478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:21:54.047249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:22:04.411865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:22:14.930705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:22:25.254197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:22:35.711035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:22:46.180556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:22:56.524536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:23:06.860843Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:23:08.677579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:23:08.677629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:23:08.677651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:23:08.677658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T14:23:08.594Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 82 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "1c15db3e-7b89-49b3-94e1-3b54061a8ad6" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "10.133.0.249:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.62:38316 10.134.0.62:443 10.132.0.13:50918 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:23:09.590260Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T14:23:09.590288Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T14:23:09.590292Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T14:23:09.590296Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-10-30T14:23:09.569Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 20 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "60c92972-e7df-44b8-9bfd-2c7cea682cb4" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.62:443 10.132.0.13:50926 - v1-completions-path [2026-10-30T14:23:16.019Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9f413094-0991-4549-86e6-8d89880a3803" "maas.apps.0d483a2e2de579d84691.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.62:443 10.132.0.13:48502 - v1-completions-path