2026-11-04T03:26:30.769254Z info FLAG: --concurrency="0" 2026-11-04T03:26:30.769283Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T03:26:30.769287Z info FLAG: --help="false" 2026-11-04T03:26:30.769289Z info FLAG: --log_as_json="false" 2026-11-04T03:26:30.769291Z info FLAG: --log_caller="" 2026-11-04T03:26:30.769293Z info FLAG: --log_output_level="default:info" 2026-11-04T03:26:30.769295Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T03:26:30.769300Z info FLAG: --log_target="[stdout]" 2026-11-04T03:26:30.769302Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T03:26:30.769304Z info FLAG: --outlierLogPath="" 2026-11-04T03:26:30.769306Z info FLAG: --profiling="true" 2026-11-04T03:26:30.769308Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T03:26:30.769310Z info FLAG: --proxyLogLevel="warning" 2026-11-04T03:26:30.769313Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T03:26:30.769315Z info FLAG: --stsPort="0" 2026-11-04T03:26:30.769316Z info FLAG: --templateFile="" 2026-11-04T03:26:30.769318Z info FLAG: --tokenManagerPlugin="" 2026-11-04T03:26:30.769321Z info FLAG: --vklog="0" 2026-11-04T03:26:30.769323Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T03:26:30.769496Z info Proxy role ips=[10.132.0.31] type=router id=maas-default-gateway-openshift-default-8b64f9ff9-v5h77.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T03:26:30.769543Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T03:26:30.770555Z info cpu limit detected as 2, setting concurrency 2026-11-04T03:26:30.770796Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T03:26:30.770807Z info JWT policy is third-party-jwt 2026-11-04T03:26:30.770810Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T03:26:30.772473Z info Starting default Istio SDS Server 2026-11-04T03:26:30.772494Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T03:26:30.772511Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T03:26:30.772989Z info Opening status port 15020 2026-11-04T03:26:30.774189Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T03:26:30.774694Z info sds Starting SDS grpc server 2026-11-04T03:26:30.774788Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T03:26:30.776044Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T03:26:30.777178Z info Starting proxy agent 2026-11-04T03:26:30.777215Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T03:26:30.840141Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T03:26:31.002789Z info ads ADS: new connection for node:1 2026-11-04T03:26:31.003420Z info ads ADS: new connection for node:2 2026-11-04T03:26:31.031219Z info cache generated new workload certificate resourceName=default latency=256.341103ms ttl=23h59m59.968784481s 2026-11-04T03:26:31.031249Z info cache Root cert has changed, start rotating root cert 2026-11-04T03:26:31.031278Z info cache returned workload certificate from cache ttl=23h59m59.968726594s 2026-11-04T03:26:31.031285Z info cache returned workload trust anchor from cache ttl=23h59m59.968715774s 2026-11-04T03:26:31.031375Z info cache returned workload trust anchor from cache ttl=23h59m59.968625083s 2026-11-04T03:26:31.031707Z info cache returned workload trust anchor from cache ttl=23h59m59.968293791s 2026-11-04T03:26:31.073292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:26:36.900826Z info Readiness succeeded in 6.133804332s 2026-11-04T03:26:36.901147Z info Envoy proxy is ready 2026-11-04T03:27:59.685754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:28:02.928658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:28:36.792322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:28:44.450579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:28:49.933547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:28:56.091903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:29:05.523447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:29:13.562996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:30:15.942110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:15.942146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:15.942159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:15.942164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T03:30:15.770Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 171 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "d307c6d1-9660-45dd-b25b-0e4121ccb7b7" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:48772 10.132.0.31:443 10.132.0.14:40508 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:30:16.258180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:16.258214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:30:16.258228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:30:16.258232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:30:16.183Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 74 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "318f2e98-21c6-4ce8-9093-9328c7c5b532" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:48772 10.132.0.31:443 10.132.0.14:40516 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:34:59.367716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:34:59.367754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:34:59.367766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:34:59.367770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:34:59.681506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:34:59.681541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:34:59.681558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:34:59.681564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:34:59.256Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 111 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "be8cda2b-47b6-417f-90f0-3f07e3130f11" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38612 10.132.0.31:443 10.132.0.14:43052 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:34:59.574Z] "DELETE /v1/api-keys/a0d73ff8-a911-4943-bea2-8c82bc3f139a HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "bf900c8c-177f-4204-9bc3-6bc9524f0b64" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38626 10.132.0.31:443 10.132.0.14:43060 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:34:59.868Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 86 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "ac491c5b-8f55-4e3f-947e-37d32591ec31" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.132.0.14:43066 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:02.311024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:02.311062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:02.311078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:02.311085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T03:35:02.203Z] "DELETE /v1/api-keys/82b721bf-a129-44a7-8b12-ebc4cc658693 HTTP/1.1" 200 - via_upstream - "-" 0 321 107 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "ec7ff19e-f66a-4280-85c6-86cf93124549" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38626 10.132.0.31:443 10.132.0.14:43068 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:03.787292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:03.787326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:03.787338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:03.787343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T03:35:03.682Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 104 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "794e04ff-69c5-472e-a736-da5461c14072" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38626 10.132.0.31:443 10.132.0.14:45608 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:04.069654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:04.069687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:04.069699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:04.069703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:35:04.833163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-04T03:35:04.836868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:04.836895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:04.836908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:35:04.836913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:35:03.967Z] "DELETE /v1/api-keys/90cf2a04-dd20-4fb0-9ceb-a636fd514a39 HTTP/1.1" 200 - via_upstream - "-" 0 321 102 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "bccca27a-c9c4-485e-b30d-d32ff5073a3e" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38612 10.132.0.31:443 10.132.0.14:45630 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:04.730Z] "DELETE /v1/api-keys/c61f4fbe-5cdc-4037-9a4a-7d30cc8b350f HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "69554e03-7b25-442a-89c4-727906cdac30" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38626 10.132.0.31:443 10.132.0.14:45644 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:05.444940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:05.444981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:05.444999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:05.445007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:35:05.337Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 108 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "c8bdabe7-f815-4081-af65-5c4dde9f9580" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38612 10.132.0.31:443 10.132.0.14:45648 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:07.597427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:07.597471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:07.597486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:35:07.597490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:35:07.493Z] "DELETE /v1/api-keys/93c81bb4-5de4-4514-ac9d-89d372e3f63c HTTP/1.1" 200 - via_upstream - "-" 0 321 104 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "6eb77043-aca1-42de-94ef-34e5f0231d50" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38626 10.132.0.31:443 10.132.0.14:45656 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:35:14.371000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:14.371033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:35:14.371045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:35:14.371049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T03:35:13.822Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 50 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "7f9cae85-6d2e-4d8c-9822-bb27995e5669" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:56986 - v1-completions-path [2026-11-04T03:35:14.251Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 119 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "53744050-10de-4dc8-936e-0ae83f1d7407" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38612 10.132.0.31:443 10.132.0.14:57000 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:15.344Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 12 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "4a56f9bc-d919-4991-8318-1ef740bf3fe5" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.31:443 10.132.0.14:57006 - - [2026-11-04T03:35:15.728Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 8 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0ea54b49-04f1-4b9d-b070-9a8cedc70d76" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.31:443 10.132.0.14:57010 - - 2026-11-04T03:35:21.706257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:21.706292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:35:21.706305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:35:21.706309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:35:21.698Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 7 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "1dba40b4-11ce-4637-9311-862ce04a0338" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38626 10.132.0.31:443 10.132.0.14:57024 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-04T03:35:21.924Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 20 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "941c9f07-60be-4706-9718-a57d73eec370" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.132.0.14:57038 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:35:38.534Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 9 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "e82f00ea-1643-4b8a-93e6-acb52fba8ef2" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.31:443 10.132.0.14:56358 - - 2026-11-04T03:38:15.502213Z info ads ADS: new connection for node:3 2026-11-04T03:38:15.512867Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T03:38:15.512978Z info cache read certificate from file resource=file-root:system 2026-11-04T03:38:22.516081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:38:31.365613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:38:57.142666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:39:06.712886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T03:39:06.719714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:39:06.719742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:39:06.719755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:39:06.719760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T03:39:06.553Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 166 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f5db231b-9650-46fb-9db8-288aef478a47" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "10.134.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:49372 10.132.0.31:443 10.132.0.14:55680 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:39:38.421370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:40:39.110434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T03:42:33.244Z] "POST /llm/e2e-dft-b30896/anything/e2e-dft-b30896-847871 HTTP/1.1" 503 - - "-" 109 0 70 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "33714074-a7f1-920e-a948-082bcba4376e" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-b30896.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:56354 - llm.external-model-e2e-dft-b30896-884d403bdb8e.2 2026-11-04T03:43:07.501565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:43:32.188661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:43:53.037356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:44:08.751602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T03:44:09.472Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 186 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "1118434f-2f6b-42af-9cc1-4f8bd1593b5d" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:56500 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:44:25.610Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 75 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b2fe6a79-70c5-4608-a28b-3e9b3fadec8b" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:43420 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:44:46.864Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 64 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "7651c2bd-0f95-4492-85fd-7c65aa96b886" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:52248 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:45:13.286Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 67 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "6a999ff2-89dd-419e-9867-57de0dc9a4f3" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:46844 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:45:24.038Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 62 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "779c3eb5-e698-4739-be5f-27c2cd5b1383" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:59106 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:46:16.992Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 66 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a8cb21c5-41de-42b8-8ea6-d54865dcc9a0" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:46392 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:47:04.767Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 65 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "075e105d-4ff4-4777-b7c3-c552614f6197" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:55232 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:47:20.625Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 63 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "28368d3f-ce7c-47aa-b030-98e9560d7bc1" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:58340 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:48:08.505Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 62 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b0a14dc2-50b6-45ee-87f6-5a68487f6951" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:37346 - llm.external-model-e2e-dft-515cbb-943242308994.2 [2026-11-04T03:48:40.261Z] "POST /llm/e2e-dft-515cbb/anything/e2e-dft-515cbb-547785 HTTP/1.1" 503 - - "-" 109 0 63 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "aeb5051e-5418-4cc9-a109-3fd7adc14c50" "maas.apps.bf3fd78ef25f0bfc1ac7.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-515cbb.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.14:54198 - llm.external-model-e2e-dft-515cbb-943242308994.2 2026-11-04T03:49:04.460534Z info ads ADS: "" 3 terminated with stream closed 2026-11-04T03:49:05.642279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:49:10.045825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8