2026-11-03T20:08:55.624509Z info FLAG: --concurrency="0" 2026-11-03T20:08:55.624527Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T20:08:55.624531Z info FLAG: --help="false" 2026-11-03T20:08:55.624533Z info FLAG: --log_as_json="false" 2026-11-03T20:08:55.624535Z info FLAG: --log_caller="" 2026-11-03T20:08:55.624537Z info FLAG: --log_output_level="default:info" 2026-11-03T20:08:55.624539Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T20:08:55.624543Z info FLAG: --log_target="[stdout]" 2026-11-03T20:08:55.624546Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T20:08:55.624548Z info FLAG: --outlierLogPath="" 2026-11-03T20:08:55.624550Z info FLAG: --profiling="true" 2026-11-03T20:08:55.624552Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T20:08:55.624554Z info FLAG: --proxyLogLevel="warning" 2026-11-03T20:08:55.624556Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T20:08:55.624558Z info FLAG: --stsPort="0" 2026-11-03T20:08:55.624559Z info FLAG: --templateFile="" 2026-11-03T20:08:55.624561Z info FLAG: --tokenManagerPlugin="" 2026-11-03T20:08:55.624564Z info FLAG: --vklog="0" 2026-11-03T20:08:55.624573Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T20:08:55.624713Z info Proxy role ips=[10.134.0.42] type=router id=maas-default-gateway-openshift-default-77f556d647-v6ll6.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T20:08:55.624756Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T20:08:55.625833Z info cpu limit detected as 2, setting concurrency 2026-11-03T20:08:55.626022Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T20:08:55.626032Z info JWT policy is third-party-jwt 2026-11-03T20:08:55.626035Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T20:08:55.628058Z info Starting default Istio SDS Server 2026-11-03T20:08:55.628083Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T20:08:55.628100Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T20:08:55.628380Z info Opening status port 15020 2026-11-03T20:08:55.629498Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T20:08:55.630751Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T20:08:55.631509Z info Starting proxy agent 2026-11-03T20:08:55.631539Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T20:08:55.640779Z info sds Starting SDS grpc server 2026-11-03T20:08:55.640798Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T20:08:55.693629Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T20:08:55.738288Z info cache generated new workload certificate resourceName=default latency=108.591616ms ttl=23h59m59.261716124s 2026-11-03T20:08:55.738342Z info cache Root cert has changed, start rotating root cert 2026-11-03T20:08:55.738393Z info cache returned workload trust anchor from cache ttl=23h59m59.261609225s 2026-11-03T20:08:55.799472Z info ads ADS: new connection for node:1 2026-11-03T20:08:55.799544Z info cache returned workload certificate from cache ttl=23h59m59.200457499s 2026-11-03T20:08:55.799827Z info ads ADS: new connection for node:2 2026-11-03T20:08:55.799907Z info cache returned workload trust anchor from cache ttl=23h59m59.200097199s 2026-11-03T20:08:55.879053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:09:03.745921Z info Readiness succeeded in 8.123969587s 2026-11-03T20:09:03.746249Z info Envoy proxy is ready [2026-11-03T20:09:43.541Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 448 81 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "b40bd338-1846-4891-af24-f0aa044a92ff" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:56870 10.134.0.42:443 10.132.0.14:40274 - v1-model-routing [2026-11-03T20:09:43.705Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 324 53 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "df8eb5ea-5aef-4d89-8fe5-2964c7bb6173" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:56870 10.134.0.42:443 10.132.0.14:40288 - v1-model-routing [2026-11-03T20:09:43.822Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 336 61 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "64ae5b9d-9538-4206-ac2b-ee97e7a4cec3" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:56886 10.134.0.42:443 10.132.0.14:40304 - v1-model-routing [2026-11-03T20:12:11.132Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 44 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "83ea1ce4-8591-4387-867d-5e8ae0cd9c3f" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.42:443 10.132.0.14:44442 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:12:12.122976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:12:12.123016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:12:12.123033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:12:12.123039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:12:12.059Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 63 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "d998c520-2a82-48e7-824a-d5b8aa1c7195" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:34224 10.134.0.42:443 10.132.0.14:44458 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:12:13.396429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:12:13.396470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:12:13.396486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:12:13.396493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:12:13.326Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 70 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a1c33fe5-0eb9-4966-bc6c-2bcaebdbaaa4" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:34230 10.134.0.42:443 10.132.0.14:44478 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:12:16.293731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T20:12:16.234Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 64 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "a724e53d-d701-4ad9-8023-89c00051b096" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:56870 10.134.0.42:443 10.132.0.14:56980 - v1-completions-path [2026-11-03T20:12:16.513Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 83 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "4006d904-ac5c-46d5-9487-ef911055dee7" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:56886 10.134.0.42:443 10.132.0.14:56988 - v1-completions-path 2026-11-03T20:12:29.114552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:12:44.449136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:15:21.075358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:15:21.075394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:15:21.075409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:15:21.075413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:15:20.984Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 91 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "df95341b-a38f-42f6-a2fc-e6f2eb13ef72" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:60708 10.134.0.42:443 10.132.0.14:37388 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:15:32.859Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 8 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "15411b9e-bbdc-4251-9399-0ac06c026339" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.42:443 10.132.0.14:33542 - - 2026-11-03T20:16:30.704160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:17:00.963485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:18:38.705194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:19:02.548794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:19:42.487072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:20:59.641406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:24:32.622902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:27:07.834469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:36:43.152698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:37:05.443165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:37:53.404731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:38:11.685585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:38:13.710383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T20:38:18.400Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 97 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "aff49da7-81dc-4d82-a5d0-5bdd9bb4842e" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:34058 10.134.0.42:443 10.132.0.14:60404 - v1-completions-path 2026-11-03T20:38:30.505882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:38:32.436268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:38:35.234867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:38:43.323520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T20:39:00.463Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "4a2e5351-1d3c-4b71-ad45-f8bfc2669983" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.132.0.14:58842 - v1-completions-path [2026-11-03T20:39:00.712Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "f507dfd4-272c-4cfc-8800-3963b4368d48" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:46234 10.134.0.42:443 10.132.0.14:58856 - v1-completions-path [2026-11-03T20:39:02.287Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "ad98a630-a53e-4971-8583-12a0dbf985b2" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:34058 10.134.0.42:443 10.132.0.14:58878 - v1-completions-path 2026-11-03T20:39:17.860436Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:39:28.204890Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:39:29.781275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:39:36.579339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T20:39:36.521Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0433d7b5-2735-492f-b0de-56c419373eea" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:46234 10.134.0.42:443 10.132.0.14:50474 - v1-completions-path 2026-11-03T20:39:48.999458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:40:02.008232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:40:16.713069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:40:19.415695Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T20:40:19.484744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:40:35.643063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:40:37.315527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:40:54.149825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:41:04.830820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:41:07.704970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T20:41:12.570Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 65 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0174ef9c-e167-4ed3-8b47-24163d4a2cd3" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:56870 10.134.0.42:443 10.132.0.14:45170 - v1-completions-path [2026-11-03T20:41:23.142Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "03d599bf-f212-4457-be90-c9788731ea04" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.132.0.14:36214 - v1-completions-path 2026-11-03T20:41:24.166972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:41:25.812164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:41:30.654399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:30.654433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:30.654445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:41:30.654451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:30.771762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:30.771796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:30.771810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:30.771816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:41:30.596Z] "DELETE /v1/api-keys/d6e1d1b9-3db6-4fba-ba80-4b2029e28e3e HTTP/1.1" 404 - via_upstream - "-" 0 29 57 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "173961a3-1895-4c95-833c-fa1c811ffeed" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:39668 10.134.0.42:443 10.132.0.14:56526 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:41:30.714Z] "DELETE /v1/api-keys/9ce8897d-eafe-4b65-a256-d11cb0f2fb4e HTTP/1.1" 200 - via_upstream - "-" 0 375 57 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "533cc0e9-3117-4816-ba65-a65cecb28be6" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:39668 10.134.0.42:443 10.132.0.14:56540 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:41:34.743590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:41:40.946397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:40.946433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:40.946445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:41:40.946450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:41:40.878Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 68 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "9f1d9c40-fd5a-4939-b5e2-9dbe08ac3c6b" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:39668 10.134.0.42:443 10.132.0.14:57980 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:41:53.111151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:42:03.229787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:47:22.173131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:47:24.449619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:49:00.961015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T20:49:00.912Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 49 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "fd4cf444-9d37-491c-a4f0-1c7b99920977" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.132.0.14:48552 - v1-completions-path 2026-11-03T20:49:02.851986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:49:06.022512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:50:31.948697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:50:44.205218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:50:44.205248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:50:44.205259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:50:44.205263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:50:44.146Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 59 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "25d5f9c2-917d-9993-8e01-857b26a64da7" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:53086 10.134.0.42:443 10.132.0.14:47436 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:50:55.802966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:50:57.538021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T20:51:02.973Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 65 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "9716633c-76f2-42f0-8113-b7207b24a6e2" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:56870 10.134.0.42:443 10.132.0.14:59010 - v1-completions-path 2026-11-03T20:51:14.858479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:52:57.165496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:52:57.165526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:52:57.165538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:52:57.165542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:52:57.101Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 64 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5bddf095-392c-4a9f-a6ea-85fdc06e972c" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:38692 10.134.0.42:443 10.132.0.14:47032 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:53:00.448489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:53:17.581495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:53:32.019218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:53:32.019252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:53:32.019266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:53:32.019270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:53:31.957Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 61 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "e267bff1-b51d-49ae-8542-b9d45811f5a3" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:38692 10.134.0.42:443 10.132.0.14:43716 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:53:33.493366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:53:45.035814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:53:47.441472Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:53:56.615081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:53:58.400193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:54:05.987008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:54:05.987045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:54:05.987062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:54:05.987067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:54:05.932Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 54 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5dff9a0e-e924-47e4-9634-ba7a0b6a740e" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:38692 10.134.0.42:443 10.132.0.14:39080 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:54:18.172901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:57:17.701215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:57:23.132127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:57:38.297207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:57:39.866772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:57:54.013781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T20:58:05.035985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9