2026-10-31T23:08:17.993505Z info FLAG: --concurrency="0" 2026-10-31T23:08:17.993532Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T23:08:17.993536Z info FLAG: --help="false" 2026-10-31T23:08:17.993538Z info FLAG: --log_as_json="false" 2026-10-31T23:08:17.993540Z info FLAG: --log_caller="" 2026-10-31T23:08:17.993558Z info FLAG: --log_output_level="default:info" 2026-10-31T23:08:17.993562Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T23:08:17.993567Z info FLAG: --log_target="[stdout]" 2026-10-31T23:08:17.993570Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T23:08:17.993571Z info FLAG: --outlierLogPath="" 2026-10-31T23:08:17.993573Z info FLAG: --profiling="true" 2026-10-31T23:08:17.993575Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T23:08:17.993578Z info FLAG: --proxyLogLevel="warning" 2026-10-31T23:08:17.993580Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T23:08:17.993582Z info FLAG: --stsPort="0" 2026-10-31T23:08:17.993584Z info FLAG: --templateFile="" 2026-10-31T23:08:17.993586Z info FLAG: --tokenManagerPlugin="" 2026-10-31T23:08:17.993588Z info FLAG: --vklog="0" 2026-10-31T23:08:17.993591Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T23:08:17.993746Z info Proxy role ips=[10.132.0.52] type=router id=maas-default-gateway-openshift-default-6886b96f9-fw9np.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T23:08:17.993790Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T23:08:17.994947Z info cpu limit detected as 2, setting concurrency 2026-10-31T23:08:17.995240Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T23:08:17.995250Z info JWT policy is third-party-jwt 2026-10-31T23:08:17.995253Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T23:08:17.997165Z info Starting default Istio SDS Server 2026-10-31T23:08:17.997186Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T23:08:17.997209Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T23:08:17.997740Z info Opening status port 15020 2026-10-31T23:08:17.998188Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T23:08:17.999378Z info sds Starting SDS grpc server 2026-10-31T23:08:17.999394Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T23:08:17.999720Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T23:08:18.000481Z info Starting proxy agent 2026-10-31T23:08:18.000510Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T23:08:18.055187Z info cache generated new workload certificate resourceName=default latency=55.668618ms ttl=23h59m59.944815235s 2026-10-31T23:08:18.055217Z info cache Root cert has changed, start rotating root cert 2026-10-31T23:08:18.055250Z info cache returned workload trust anchor from cache ttl=23h59m59.944750423s 2026-10-31T23:08:18.061444Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T23:08:18.159131Z info ads ADS: new connection for node:1 2026-10-31T23:08:18.159214Z info cache returned workload certificate from cache ttl=23h59m59.840787452s 2026-10-31T23:08:18.159628Z info ads ADS: new connection for node:2 2026-10-31T23:08:18.159696Z info cache returned workload trust anchor from cache ttl=23h59m59.840305364s 2026-10-31T23:08:18.237325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:08:25.807984Z info Readiness succeeded in 7.817228352s 2026-10-31T23:08:25.808297Z info Envoy proxy is ready [2026-10-31T23:10:49.429Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 281 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "a32e9aa5-f82d-4faf-8545-9c5c0a84b0f8" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:60124 10.132.0.52:443 10.132.0.11:57338 - v1-completions-path [2026-10-31T23:10:51.089Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 15 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "78149880-6480-4026-b12b-6a4ee49bc3db" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.52:443 10.132.0.11:44130 - - 2026-10-31T23:11:00.336634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:11:18.905975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:14:17.895118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:14:17.895239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:14:17.895296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:14:17.895328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T23:14:17.895660Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-31T23:14:17.895789Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T23:14:17.895825Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T23:14:17.895849Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T23:14:17.895872Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T23:14:17.581Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 313 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "f7cff718-fa8f-4245-bec3-5363d660c2ff" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:60124 10.132.0.52:443 10.132.0.11:37240 - v1-completions-path 2026-10-31T23:14:38.527246Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: gRPC status code is not OK thread=26 [2026-10-31T23:14:37.497Z] "POST /maas-api/v1/tokens HTTP/1.1" 500 - - "-" 20 23 1031 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "72696ef1-d0b0-45f7-a9f1-8c212ed5e4cb" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.52:443 10.132.0.11:57418 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T23:14:47.519400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:14:47.519435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:14:47.519448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T23:14:47.519453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-31T23:14:47.419Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 99 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "0cab7247-1873-48ed-8d2c-ff4250551114" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:33340 10.132.0.52:443 10.132.0.11:57846 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T23:14:47.579Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 1554 69 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "e03cc37a-bca2-4752-b9e1-1c702fb5a424" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:60124 10.132.0.52:443 10.132.0.11:57860 - v1-chat-completions-path 2026-10-31T23:15:07.635450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:15:47.152381Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:17:05.365307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:18:18.965012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:18:46.984833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:19:45.057408Z warn xdsproxy sendDownstreamDelta took 11.514272513s 2026-10-31T23:22:03.596467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:26:01.187410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:26:01.187451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:26:01.187465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:26:01.187471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T23:26:01.098Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 89 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "e1139e3a-4284-4646-af87-b05426213bc3" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:43902 10.132.0.52:443 10.132.0.11:39314 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T23:26:03.342997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:26:23.964059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:27:08.716323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:27:26.842232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:27:28.463279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:27:34.324349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:27:34.324385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:27:34.324400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T23:27:34.324405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T23:27:34.254Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 70 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "3e0d5ff4-1726-4a7a-b597-a577827997d9" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:42722 10.132.0.52:443 10.132.0.11:49968 - v1-catch-all-path 2026-10-31T23:27:45.861305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:27:47.582162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:27:50.769701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:27:58.729285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T23:28:07.769Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "19527ff6-f05d-4a22-9996-c061cfb9ed0b" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:41264 10.132.0.52:443 10.132.0.11:50114 - v1-completions-path 2026-10-31T23:28:07.947600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T23:28:07.888Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "d8a50425-9326-4172-9b06-a3d0202b2a63" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:42722 10.132.0.52:443 10.132.0.11:50116 - v1-completions-path 2026-10-31T23:28:23.473848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:28:33.802647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:28:37.620691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:28:43.667882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-10-31T23:28:43.609Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "0a3d279a-d76d-4e70-b044-c742a1e6b45e" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:41264 10.132.0.52:443 10.132.0.11:58550 - v1-completions-path [2026-10-31T23:28:44.573Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "da69cbae-1f22-492e-bab0-e7ef28bbbd11" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:41264 10.132.0.52:443 10.132.0.11:58562 - v1-completions-path 2026-10-31T23:28:56.612526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:28:58.255378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:29:03.138740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:29:03.138779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:29:03.138796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T23:29:03.138801Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T23:29:03.059Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 79 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "705f0cfc-4d86-4ec0-af9b-9cf71def8e4e" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:48758 10.132.0.52:443 10.132.0.11:52532 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T23:29:14.902378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:29:17.272066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:29:33.500361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:29:35.297703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:29:51.361375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:30:02.145980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:30:05.010985Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:30:23.467301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:30:25.092774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:30:33.928875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:30:49.140770Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T23:30:52.390665Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:31:02.560592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:36:21.301390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:36:23.848626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:37:48.935160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:37:48.935199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:37:48.935218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:37:48.935223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T23:37:48.868Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 67 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "df30618a-a98b-4b04-aa71-2f55f5fe2a3f" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:57210 10.132.0.52:443 10.132.0.11:45798 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T23:37:59.410Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 53 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "4a947a11-f2f6-4ec1-bcbf-bc3868ed75cc" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.52:443 10.132.0.11:42700 - v1-completions-path 2026-10-31T23:38:00.390347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:38:02.165199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:39:26.347614Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-31T23:39:26.347638Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-31T23:39:26.347641Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-31T23:39:26.347645Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-10-31T23:39:26.300Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 47 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "62c93968-1d50-44d4-b80f-3fd41e73286c" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.52:443 10.132.0.11:41844 - v1-completions-path 2026-10-31T23:39:45.342958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T23:39:57.654Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 287 102 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "2d01c1fa-37d6-4b04-962a-5ebb43bdbe93" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:40698 10.132.0.52:443 10.132.0.11:52336 - v1-completions-path 2026-10-31T23:39:58.583513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:39:58.583576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:39:58.583600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:39:58.583607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T23:39:58.489Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 94 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "1039052b-8927-43e8-b4a8-01bbff960c96" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:42110 10.132.0.52:443 10.132.0.11:52350 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T23:40:10.030000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:40:12.240306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:40:29.053906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:41:55.927917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:42:12.642715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:42:28.311594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:42:40.040756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:42:43.536948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:42:43.536982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:42:43.536996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T23:42:43.537001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T23:42:43.779587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T23:42:43.465Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 71 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "557d7343-4d95-45ca-9398-2f110161fef3" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:51050 10.132.0.52:443 10.132.0.11:40298 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T23:42:54.978661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:42:57.384912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:43:03.354455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:43:03.354629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T23:43:03.354691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T23:43:03.354732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T23:43:03.257Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 97 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "49ce94df-0d8c-40c2-aeae-cb4b05b34e95" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.52:45344 10.132.0.52:443 10.132.0.11:57596 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T23:43:15.460408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:46:04.851946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:46:08.028230Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-31T23:46:07.937Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 91 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "58530ae4-fdb0-4f13-a61c-c12b619e5c26" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:37004 10.132.0.52:443 10.132.0.11:48932 - v1-catch-all-path 2026-10-31T23:46:10.370870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:46:13.921618Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-31T23:46:13.857Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 64 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "6c059934-efb0-49f2-b3ca-51d45ce0f0b1" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:37004 10.132.0.52:443 10.132.0.11:40916 - v1-catch-all-path 2026-10-31T23:46:25.867409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:46:27.665470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:46:30.822062Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-31T23:46:30.756Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 65 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9170b00c-7d82-47eb-9c1c-f462004c70ef" "maas.apps.a1ffc7c190b3a7c6f282.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.52:37004 10.132.0.52:443 10.132.0.11:34054 - v1-catch-all-path 2026-10-31T23:46:42.302188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T23:46:52.990731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8