2026-11-02T03:13:51.741160Z info FLAG: --concurrency="0" 2026-11-02T03:13:51.741186Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T03:13:51.741192Z info FLAG: --help="false" 2026-11-02T03:13:51.741195Z info FLAG: --log_as_json="false" 2026-11-02T03:13:51.741198Z info FLAG: --log_caller="" 2026-11-02T03:13:51.741202Z info FLAG: --log_output_level="default:info" 2026-11-02T03:13:51.741205Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T03:13:51.741211Z info FLAG: --log_target="[stdout]" 2026-11-02T03:13:51.741214Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T03:13:51.741217Z info FLAG: --outlierLogPath="" 2026-11-02T03:13:51.741220Z info FLAG: --profiling="true" 2026-11-02T03:13:51.741223Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T03:13:51.741226Z info FLAG: --proxyLogLevel="warning" 2026-11-02T03:13:51.741229Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T03:13:51.741232Z info FLAG: --stsPort="0" 2026-11-02T03:13:51.741235Z info FLAG: --templateFile="" 2026-11-02T03:13:51.741238Z info FLAG: --tokenManagerPlugin="" 2026-11-02T03:13:51.741242Z info FLAG: --vklog="0" 2026-11-02T03:13:51.741246Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T03:13:51.741418Z info Proxy role ips=[10.133.0.51] type=router id=maas-default-gateway-openshift-default-58847f9fc5-nmpc6.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T03:13:51.741475Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T03:13:51.743254Z info cpu limit detected as 2, setting concurrency 2026-11-02T03:13:51.743644Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T03:13:51.743658Z info JWT policy is third-party-jwt 2026-11-02T03:13:51.743660Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T03:13:51.745582Z info Starting default Istio SDS Server 2026-11-02T03:13:51.745607Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T03:13:51.745661Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T03:13:51.746091Z info Opening status port 15020 2026-11-02T03:13:51.747117Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T03:13:51.748915Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T03:13:51.750132Z info Starting proxy agent 2026-11-02T03:13:51.750171Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T03:13:51.766802Z info sds Starting SDS grpc server 2026-11-02T03:13:51.766829Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T03:13:51.817538Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T03:13:51.936847Z info cache generated new workload certificate resourceName=default latency=189.929897ms ttl=23h59m59.063157131s 2026-11-02T03:13:51.936880Z info cache Root cert has changed, start rotating root cert 2026-11-02T03:13:51.936909Z info cache returned workload trust anchor from cache ttl=23h59m59.063091857s 2026-11-02T03:13:52.006218Z info ads ADS: new connection for node:1 2026-11-02T03:13:52.011949Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T03:13:52.012009Z info cache read certificate from file resource=file-root:system 2026-11-02T03:13:52.044415Z info ads ADS: new connection for node:2 2026-11-02T03:13:52.044486Z info cache returned workload certificate from cache ttl=23h59m58.95551644s 2026-11-02T03:13:52.044928Z info ads ADS: new connection for node:3 2026-11-02T03:13:52.045015Z info cache returned workload trust anchor from cache ttl=23h59m58.954985707s 2026-11-02T03:13:52.133253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:14:00.490334Z info Readiness succeeded in 8.752092063s 2026-11-02T03:14:00.490866Z info Envoy proxy is ready 2026-11-02T03:14:10.620533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:14:10.620568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:14:10.620577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T03:14:10.620582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:14:10.620778Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T03:14:10.492Z] "POST /llm/e2e-rt-sw-79a1da/anything/e2e-rt-sw-79a1da-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 128 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "71fcf400-5551-40cb-93d4-ce8c27936462" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-79a1da.llm.svc.cluster.local - 10.133.0.51:443 10.132.0.21:58014 - llm.external-model-e2e-rt-sw-79a1da-bc2ab86b9228.2 2026-11-02T03:14:28.727573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:14:28.727607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:14:28.727638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T03:14:28.727645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:14:28.727835Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T03:14:28.601Z] "POST /anything/e2e-rt-sw-79a1da-client HTTP/1.1" 200 - via_upstream - "-" 124 1775 126 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "486b57df-ee44-43b3-918a-1049741c1010" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.51:55876 10.133.0.51:443 10.132.0.21:39758 - llm.external-model-e2e-rt-sw-79a1da-bc2ab86b9228.0 2026-11-02T03:14:37.387530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:14:46.935422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:14:46.935453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:14:46.935461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:14:46.935465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T03:14:46.935648Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T03:14:46.808Z] "POST /anything/e2e-rt-sw-79a1da-client HTTP/1.1" 200 - via_upstream - "-" 124 1776 127 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "2e4e38f2-9c9d-47a2-837c-05becdffb436" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.51:57000 10.133.0.51:443 10.132.0.21:52024 - llm.external-model-e2e-rt-sw-79a1da-bc2ab86b9228.0 2026-11-02T03:15:00.636712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:15:18.655828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:15:21.606201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:15:21.606242Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:15:21.606260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:15:21.606265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T03:15:21.226Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 380 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "270c5f4b-0ea5-4c58-83c3-00225fe48ccb" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:34216 10.133.0.51:443 10.132.0.21:46986 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:16:14.262282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:16:17.205659Z info ads ADS: "" 1 terminated with stream closed 2026-11-02T03:16:17.291144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:16:26.302075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:18:04.018516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:18:27.064345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:19:00.211518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:20:14.294516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:27:16.483238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:27:16.483275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:27:16.483290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T03:27:16.483295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T03:27:16.107Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 52 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "5a6c64d9-0cfb-4669-8b1d-5dbc3d5ff386" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.51:443 10.132.0.21:51898 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T03:27:16.372Z] "DELETE /v1/api-keys/8660867f-180f-4315-b45b-b9bab9ccd5d7 HTTP/1.1" 200 - via_upstream - "-" 0 370 111 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "098ac7e0-45db-9c49-92a6-fb24fbc7853f" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:36506 10.133.0.51:443 10.132.0.21:51902 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:27:16.974600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:27:16.974650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:27:16.974664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:27:16.974669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T03:27:16.855Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 119 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "30a792b9-28de-481e-8bbe-87198fdfb76d" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:36506 10.133.0.51:443 10.132.0.21:51910 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T03:27:19.326Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 128 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "50772f29-14c1-4a1f-bfd9-dae6f8ea48fb" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.51:443 10.132.0.21:51936 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:27:22.513571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:27:22.513605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:27:22.513647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T03:27:22.513653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:27:23.295147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.295188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.295202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T03:27:23.295207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.475533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.475565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.475578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.475583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T03:27:22.397Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 116 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "8c50be0a-78dc-41d5-b849-923826ec8e7c" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:36506 10.133.0.51:443 10.132.0.21:51942 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T03:27:23.179Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 115 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "5ba122b6-7b47-4d02-a7e3-d7452d1ad7a1" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:36510 10.133.0.51:443 10.132.0.21:51952 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T03:27:23.354Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 120 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "fd98fd0e-4566-4eae-a3a5-a944eb146427" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:36510 10.133.0.51:443 10.132.0.21:51964 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:27:23.974188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.974221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.974234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:23.974239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T03:27:23.861Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 112 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "0f89ec84-5737-4eeb-a0ce-e77134c82fb7" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:36510 10.133.0.51:443 10.132.0.21:51990 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T03:27:24.759Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 86 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "8fbe6c9d-e93e-405e-a468-fa577cdf6495" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.51:443 10.132.0.21:52006 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:27:25.914833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:25.914868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:27:25.914882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T03:27:25.914886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T03:27:25.806Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 108 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "016d0891-bdb6-406c-9600-fb80a34d932c" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:36510 10.133.0.51:443 10.132.0.21:52724 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:27:32.449636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T03:27:32.443Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 80 - "52.71.36.72,10.132.0.21" "-" "a5d4ac45-a119-4097-9243-bf538aff8570" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.51:58606 10.133.0.51:443 10.132.0.21:52748 - v1-completions-path 2026-11-02T03:27:39.132378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T03:27:39.072Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 64 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "36c2c039-0cf6-42ee-a4a1-c1a136479628" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.51:60660 10.133.0.51:443 10.132.0.21:55546 - v1-completions-path 2026-11-02T03:27:39.842555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:28:10.543818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T03:28:16.698070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:28:16.698116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T03:28:16.698140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T03:28:16.698147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T03:28:16.530Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 167 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "d3f096e7-2df3-43b4-99c1-e2bc79af5ada" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:36506 10.133.0.51:443 10.132.0.21:58438 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T03:41:59.007013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:41:59.007053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:41:59.007071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:41:59.007076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T03:41:58.806Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 200 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "560e556c-0ca3-4610-b247-4545b0302b02" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:54694 10.133.0.51:443 10.132.0.21:43462 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T03:41:59.560Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 321 72 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "e0c059b2-0c5b-43f5-ac5b-89a53c9d17b0" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.51:58606 10.133.0.51:443 10.132.0.21:43470 - v1-chat-completions-path [2026-11-02T03:41:59.837Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 3577 64 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "095eef63-619a-46aa-955d-5792e19fba04" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.51:58606 10.133.0.51:443 10.132.0.21:43484 - v1-chat-completions-path 2026-11-02T03:42:26.434554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:42:26.434589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:42:26.434606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T03:42:26.434611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T03:42:26.313Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 120 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "b6188917-878f-4b64-83b8-4008214d6474" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.51:54694 10.133.0.51:443 10.132.0.21:47750 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T03:42:26.629Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 329 81 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "e7de99c0-8059-45fb-ae98-c88ab4a6f13e" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.51:58606 10.133.0.51:443 10.132.0.21:47758 - v1-chat-completions-path 2026-11-02T03:42:35.196034Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 [2026-11-02T03:57:09.247Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 10 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "490903fa-8aef-4a49-859c-6c135a763c52" "maas.apps.a35577c17192f44604e0.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.51:443 10.132.0.21:54486 - -