2026-10-30T21:36:37.653771Z info FLAG: --concurrency="0" 2026-10-30T21:36:37.653788Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T21:36:37.653792Z info FLAG: --help="false" 2026-10-30T21:36:37.653794Z info FLAG: --log_as_json="false" 2026-10-30T21:36:37.653796Z info FLAG: --log_caller="" 2026-10-30T21:36:37.653798Z info FLAG: --log_output_level="default:info" 2026-10-30T21:36:37.653801Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T21:36:37.653805Z info FLAG: --log_target="[stdout]" 2026-10-30T21:36:37.653807Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T21:36:37.653809Z info FLAG: --outlierLogPath="" 2026-10-30T21:36:37.653811Z info FLAG: --profiling="true" 2026-10-30T21:36:37.653813Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T21:36:37.653815Z info FLAG: --proxyLogLevel="warning" 2026-10-30T21:36:37.653817Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T21:36:37.653819Z info FLAG: --stsPort="0" 2026-10-30T21:36:37.653821Z info FLAG: --templateFile="" 2026-10-30T21:36:37.653823Z info FLAG: --tokenManagerPlugin="" 2026-10-30T21:36:37.653826Z info FLAG: --vklog="0" 2026-10-30T21:36:37.653828Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T21:36:37.653974Z info Proxy role ips=[10.134.0.37] type=router id=maas-default-gateway-openshift-default-75fd9f5d47-wtthn.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T21:36:37.654029Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T21:36:37.654993Z info cpu limit detected as 2, setting concurrency 2026-10-30T21:36:37.655247Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T21:36:37.655258Z info JWT policy is third-party-jwt 2026-10-30T21:36:37.655261Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T21:36:37.656670Z info Starting default Istio SDS Server 2026-10-30T21:36:37.656701Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T21:36:37.656725Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T21:36:37.657106Z info Opening status port 15020 2026-10-30T21:36:37.657908Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T21:36:37.658612Z info sds Starting SDS grpc server 2026-10-30T21:36:37.658627Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T21:36:37.659349Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T21:36:37.660240Z info Starting proxy agent 2026-10-30T21:36:37.660276Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T21:36:37.733072Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T21:36:37.779319Z info cache generated new workload certificate resourceName=default latency=120.575439ms ttl=23h59m59.220684666s 2026-10-30T21:36:37.779350Z info cache Root cert has changed, start rotating root cert 2026-10-30T21:36:37.779377Z info cache returned workload trust anchor from cache ttl=23h59m59.220623626s 2026-10-30T21:36:37.831410Z info ads ADS: new connection for node:1 2026-10-30T21:36:37.831557Z info cache returned workload certificate from cache ttl=23h59m59.168445047s 2026-10-30T21:36:37.832560Z info ads ADS: new connection for node:2 2026-10-30T21:36:37.832635Z info cache returned workload trust anchor from cache ttl=23h59m59.167366911s 2026-10-30T21:36:37.918760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:36:45.706120Z info Readiness succeeded in 8.055259601s 2026-10-30T21:36:45.706487Z info Envoy proxy is ready [2026-10-30T21:38:56.273Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 94 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "0042031c-68ca-4db0-a2e0-7c9ff3454ef8" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.37:443 10.132.0.8:54844 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:38:56.799159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:56.799204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:56.799225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:38:56.799231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T21:38:56.679Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 119 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "be772fa1-7031-4929-bf7d-69b2a6b4868c" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:42250 10.134.0.37:443 10.132.0.8:54848 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:38:57.814841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:57.814878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:57.814892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:38:57.814897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T21:38:57.740Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 74 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "20d13a49-9fa8-4c5f-bb11-390003e1e73a" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:42250 10.134.0.37:443 10.132.0.8:54862 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:38:57.938353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:57.938385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:57.938399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:38:57.938404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:58.644325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:58.644370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:58.644391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:38:58.644398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T21:38:57.866Z] "DELETE /v1/api-keys/9032b104-4c49-4903-b59d-c0ec752c6597 HTTP/1.1" 200 - via_upstream - "-" 0 321 72 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "7a1bbda0-b195-46cc-85b8-26c737a117a1" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:42250 10.134.0.37:443 10.132.0.8:54878 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T21:38:58.578Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 66 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "b6aa50d2-1d45-495f-8090-55b3d82543a7" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:42250 10.134.0.37:443 10.132.0.8:54890 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:39:02.367931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:02.367996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:02.368010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:39:02.368015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T21:39:02.296Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 71 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "bd766697-2131-4fca-8bfd-1819f49a4277" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:42250 10.134.0.37:443 10.132.0.8:54900 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:39:03.828287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:03.828334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:03.828355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:39:03.828363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T21:39:03.740Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 88 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "bf771f2d-7f16-4f99-b98e-1aa68b73e223" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:42262 10.134.0.37:443 10.132.0.8:54914 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:39:15.513107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:39:30.029353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:42:53.824646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:42:53.824697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:42:53.824728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:42:53.824737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T21:42:53.717Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 107 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "e81a9b6a-16ff-4ab7-a0c8-a7bbacf11cbf" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:41236 10.134.0.37:443 10.132.0.8:48716 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:43:02.991653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:43:14.161234Z warn xdsproxy sendDownstreamDelta took 10.852581527s 2026-10-30T21:43:51.607662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:45:16.353450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:45:58.430278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:47:48.267828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:52:17.680581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:52:17.680623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:52:17.680637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:52:17.680642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T21:52:17.609Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 71 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "48b78145-d5ee-4013-b0df-3fa17d2e035a" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:60206 10.134.0.37:443 10.132.0.8:48362 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:52:20.602393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:52:42.893657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:53:29.927097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T21:53:32.849Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 80 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "f38ac143-90a7-4cae-86c1-70cf8345b9a6" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:56276 10.134.0.37:443 10.132.0.8:56490 - v1-completions-path 2026-10-30T21:53:45.427545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:53:47.233040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:53:52.193747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:53:52.193790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:53:52.193805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:53:52.193809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T21:53:52.126Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 67 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "ad1848c4-d9f1-4571-a2d2-32a4f83e11f6" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:58322 10.134.0.37:443 10.132.0.8:41350 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:54:04.269536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T21:54:03.651Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 87 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "1c4033c8-53a1-40ce-b904-251c0d02c261" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:51738 10.134.0.37:443 10.132.0.8:46046 - v1-completions-path 2026-10-30T21:54:06.056826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:54:08.792040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:54:17.393744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:54:23.123184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:54:23.123219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:54:23.123233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:54:23.123238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T21:54:23.053Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 70 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "ef701564-2e1c-44fc-b54a-35f1c3b20a67" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:48146 10.134.0.37:443 10.132.0.8:49686 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T21:54:24.390Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 305 64 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "0e0b0b7e-dae8-417f-abda-cf61108c9470" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:59632 10.134.0.37:443 10.132.0.8:34526 - v1-completions-path 2026-10-30T21:54:25.938455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T21:54:25.890Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 53 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "b2ec927d-aabc-40c8-9723-f56b733583fc" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:59632 10.134.0.37:443 10.132.0.8:34546 - v1-completions-path 2026-10-30T21:54:42.008136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:54:52.097516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:54:54.126118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:55:00.051103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T21:54:59.992Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "9d5f842d-5f17-48f7-a7a9-1cecd39f98fd" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:56276 10.134.0.37:443 10.132.0.8:49780 - v1-completions-path [2026-10-30T21:55:00.338Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 84 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "8e78fa73-373c-4ac4-84fc-43283aa16a12" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:56276 10.134.0.37:443 10.132.0.8:49782 - v1-completions-path [2026-10-30T21:55:00.607Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "aece7a0d-b010-4e74-b1a4-7a20220227ae" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:56276 10.134.0.37:443 10.132.0.8:49792 - v1-completions-path [2026-10-30T21:55:00.954Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "455cefd8-ea4c-4eba-ace4-71bc0b0e4d54" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:59632 10.134.0.37:443 10.132.0.8:49798 - v1-completions-path 2026-10-30T21:55:13.036015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:55:14.885858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T21:55:19.736Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 286 73 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "3a291443-f897-45ea-9b31-cb182b174c00" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:43250 10.134.0.37:443 10.132.0.8:45518 - v1-completions-path 2026-10-30T21:55:31.476393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T21:55:31.421Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 94 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "395186df-96f4-40cc-805f-1969b6c9fa9e" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:41086 10.134.0.37:443 10.132.0.8:60058 - v1-completions-path 2026-10-30T21:55:33.720032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:55:50.400171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:55:52.052563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:56:08.331938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:56:18.989794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:56:21.618193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:56:37.784886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:56:40.113050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:56:43.268216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:56:43.268254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:56:43.268271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:56:43.268276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T21:56:43.203Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 331 64 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "2a223811-5a92-44f8-9d37-7bf21af9af3f" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43884 10.134.0.37:443 10.132.0.8:43784 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T21:56:43.449Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "1ee3a5c4-e1b9-4e6c-8663-3f3c1863fec5" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.8:43796 - v1-completions-path [2026-10-30T21:56:45.075Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 33 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "6f091b0b-4e75-49a9-8734-b2b265d02ddb" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.132.0.8:47784 - v1-completions-path 2026-10-30T21:56:47.663318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:56:54.066819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:56:54.066857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:56:54.066872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:56:54.066877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T21:56:54.009Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 57 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "0e0e8d47-c03b-4b46-b7be-4ffba5859675" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:45470 10.134.0.37:443 10.132.0.8:47814 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:57:06.075355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:57:16.264906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:32.591519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:34.838191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:04:15.385195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:04:18.324556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:04:56.226718Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T22:05:44.456704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:05:59.504866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:06:01.328311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:06:18.586974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:07:46.400824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:03.756835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:17.952111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:17.952154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:17.952178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:08:17.952185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:08:17.886Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 66 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "8df480ba-3b01-4e4d-8f72-be7f442f7c86" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:60644 10.134.0.37:443 10.132.0.8:42276 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:08:20.016411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:31.174399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:34.794691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:45.745390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:48.142837Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:54.866655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:54.866695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:54.866711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:54.866717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:08:54.813Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 52 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "e21aa09a-49ba-4f82-8af0-e0aa659eaeee" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:60644 10.134.0.37:443 10.132.0.8:58842 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:09:06.449016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:11:56.135716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:11:58.857570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:11:58.857605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:11:58.857620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:11:58.857625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T22:11:58.774Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 83 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "1000ea91-c86d-4390-b94c-7b5078a7bad7" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.132.0.120:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:51400 10.134.0.37:443 10.132.0.8:43704 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:12:01.337121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:12:16.549577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:12:18.240433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:12:20.957160Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T22:12:20.882Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "52.71.36.72,10.132.0.8" "python-requests/2.34.2" "6fdb49ad-68f2-42fd-a2cd-eeebece7a6dc" "maas.apps.66c55855e4bcd91f0fc2.prod.konflux-ocp-ci.dev" "10.133.0.30:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:56896 10.134.0.37:443 10.132.0.8:57338 - v1-catch-all-path 2026-10-30T22:12:32.476061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:12:43.362616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8