2026-10-30T04:35:07.826772Z info FLAG: --concurrency="0" 2026-10-30T04:35:07.826800Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T04:35:07.826804Z info FLAG: --help="false" 2026-10-30T04:35:07.826807Z info FLAG: --log_as_json="false" 2026-10-30T04:35:07.826809Z info FLAG: --log_caller="" 2026-10-30T04:35:07.826811Z info FLAG: --log_output_level="default:info" 2026-10-30T04:35:07.826813Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T04:35:07.826817Z info FLAG: --log_target="[stdout]" 2026-10-30T04:35:07.826819Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T04:35:07.826821Z info FLAG: --outlierLogPath="" 2026-10-30T04:35:07.826823Z info FLAG: --profiling="true" 2026-10-30T04:35:07.826825Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T04:35:07.826827Z info FLAG: --proxyLogLevel="warning" 2026-10-30T04:35:07.826830Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T04:35:07.826832Z info FLAG: --stsPort="0" 2026-10-30T04:35:07.826833Z info FLAG: --templateFile="" 2026-10-30T04:35:07.826835Z info FLAG: --tokenManagerPlugin="" 2026-10-30T04:35:07.826838Z info FLAG: --vklog="0" 2026-10-30T04:35:07.826840Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T04:35:07.827008Z info Proxy role ips=[10.132.1.33] type=router id=maas-default-gateway-openshift-default-64d4cc998c-hs7rr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T04:35:07.827057Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T04:35:07.828096Z info cpu limit detected as 2, setting concurrency 2026-10-30T04:35:07.828290Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T04:35:07.828300Z info JWT policy is third-party-jwt 2026-10-30T04:35:07.828303Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T04:35:07.829969Z info Starting default Istio SDS Server 2026-10-30T04:35:07.830024Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T04:35:07.830061Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T04:35:07.830158Z info Opening status port 15020 2026-10-30T04:35:07.831350Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T04:35:07.831614Z info sds Starting SDS grpc server 2026-10-30T04:35:07.831632Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T04:35:07.832640Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T04:35:07.833467Z info Starting proxy agent 2026-10-30T04:35:07.833500Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T04:35:07.906555Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T04:35:07.974303Z info cache generated new workload certificate resourceName=default latency=143.482984ms ttl=23h59m59.025701021s 2026-10-30T04:35:07.974339Z info cache Root cert has changed, start rotating root cert 2026-10-30T04:35:07.974372Z info cache returned workload trust anchor from cache ttl=23h59m59.025628462s 2026-10-30T04:35:08.018896Z info ads ADS: new connection for node:1 2026-10-30T04:35:08.018997Z info cache returned workload certificate from cache ttl=23h59m58.981005765s 2026-10-30T04:35:08.019914Z info ads ADS: new connection for node:2 2026-10-30T04:35:08.020007Z info cache returned workload trust anchor from cache ttl=23h59m58.979994391s 2026-10-30T04:35:08.103330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:35:16.009703Z info Readiness succeeded in 8.185941837s 2026-10-30T04:35:16.010129Z info Envoy proxy is ready 2026-10-30T04:35:35.835347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:35:41.051Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 149 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "09361d9b-2154-4217-a9a0-f3d5e7c4e70f" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:45928 10.132.1.33:443 10.132.0.20:38812 - v1-chat-completions-path 2026-10-30T04:35:53.278957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:35:55.776975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:06.709903Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:12.719192Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T04:36:12.645Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 73 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "8bbfde51-b711-435c-8a3e-6ddb44935f43" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.30:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:37880 10.132.1.33:443 10.132.0.20:36546 - v1-catch-all-path 2026-10-30T04:36:24.738268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:26.972586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:41.761048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:52.525108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:36:54.504067Z info ads ADS: new connection for node:3 2026-10-30T04:36:54.504219Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:36:54.504248Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:36:56.222169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:37:36.542600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:37:44.742142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:37:44.742180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:37:44.742195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:37:44.742200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T04:37:44.659Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 82 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7c3e51d4-26d5-45d6-8175-c47bac177f14" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.33:52534 10.132.1.33:443 10.132.0.20:37246 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:37:59.270Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 38 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "baa24c1d-f3b3-47d3-8543-c9dc30f3d055" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-89562748-inference-pool-ip-eef2bbad.llm.svc.cluster.local - 10.132.1.33:443 10.132.0.20:43376 - v1-model-routing 2026-10-30T04:38:00.711701Z info ads ADS: "" 3 terminated 2026-10-30T04:38:00.761389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:38:02.210078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:38:04.356571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:38:09.453455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:39:41.210725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:39:41.210762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:39:41.210777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:39:41.210782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:39:41.123Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 87 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "df840c16-3f7e-47ee-9215-7ae31e5e2cf2" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.33:38230 10.132.1.33:443 10.132.0.20:35468 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:39:45.896545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:02.987544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:23.809348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:35.831072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:39.497346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:49.698029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:54.109187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:40:59.632512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T04:40:59.632585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:40:59.632608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:40:59.632625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:40:59.632630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:41:00.356173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:41:00.356211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:41:00.356229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:41:00.356234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:40:59.558Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 74 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7264eba3-c9c1-40af-8718-30387d2f7249" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.33:39860 10.132.1.33:443 10.132.0.20:34994 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:41:00.305Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 50 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a3074805-b053-4617-9381-d14ce3bd80c5" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.33:39860 10.132.1.33:443 10.132.0.20:35006 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:41:12.283810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:41:54.938Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 82 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "5717a453-3dbf-404d-bf77-0dc00c8335e8" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:57108 10.132.1.33:443 10.132.0.20:55924 - v1-completions-path 2026-10-30T04:41:56.208942Z info ads ADS: new connection for node:4 2026-10-30T04:41:56.214481Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T04:41:56.214536Z info cache read certificate from file resource=file-root:system 2026-10-30T04:41:57.373752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:41:58.879873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:42:38.060138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:42:38.060168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:42:38.060178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:42:38.060183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:42:38.060340Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T04:42:37.951Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1730 108 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "b416fd52-ff8d-4901-9a5b-06eb549c8556" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.33:58862 10.132.1.33:443 10.132.0.20:55048 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:43:29.616519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:43:29.729331Z info ads ADS: "" 4 terminated 2026-10-30T04:43:30.026437Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:43:30.026461Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:43:30.026464Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:43:30.026468Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T04:43:29.987Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 38 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "11282497-06ec-4033-97a5-573c0ef0b5bf" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.33:443 10.132.0.20:58424 - v1-completions-path 2026-10-30T04:43:31.017856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:43:36.633089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:43:43.368Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 125 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "88ad8a3f-67c0-4cab-a3f8-8eda00cf3ed8" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:34744 - v1-completions-path 2026-10-30T04:43:55.536896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:00.116642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:03.260528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T04:44:03.203Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d5de15ee-a8ab-4739-b316-d628c3f4e95c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:56428 - v1-completions-path 2026-10-30T04:44:15.450697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:17.771370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:20.692914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:44:30.897380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:44:37.456Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "6bdfb525-b66a-4ae7-a4e5-559507e592f8" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:49132 10.132.1.33:443 10.132.0.20:33248 - v1-completions-path [2026-10-30T04:44:38.052Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 53 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ca6ca969-b76d-43dc-bcb8-9f33df42871c" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:56126 - v1-completions-path 2026-10-30T04:44:54.391407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:04.673952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:09.148793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:45:14.227Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "142fee2b-69fe-468f-88a9-8f49f1188cfd" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:49132 10.132.1.33:443 10.132.0.20:49034 - v1-completions-path 2026-10-30T04:45:26.323525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:28.684256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:45:35.764Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 291 74 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "426da1a3-8068-4842-9cbc-91f9ca6b319b" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:51044 10.132.1.33:443 10.132.0.20:40996 - v1-completions-path 2026-10-30T04:45:47.797859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:45:52.199321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:07.693912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:10.025681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:27.644615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:38.326471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:46:41.193306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:00.372316Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:03.310306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:15.581161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:33.358842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:47:43.706913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:48:03.059235Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:48:06.350017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:49:45.865Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3a5c1a68-7b87-4e86-8c23-180fb2d2ccbd" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.33:443 10.132.0.20:42714 - v1-completions-path 2026-10-30T04:49:48.031399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:49:51.448898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:51:21.516844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:51:35.952938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:51:38.326222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:51:44.761Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 67 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "75328a7a-7315-4277-80a5-94d635f98337" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:57108 10.132.1.33:443 10.132.0.20:43158 - v1-completions-path 2026-10-30T04:51:45.036230Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:51:45.036256Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:51:45.036259Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:51:45.036263Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T04:51:45.003Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 33 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "9787db0d-ca15-420e-9f3f-9db0a0a233f8" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.33:443 10.132.0.20:43164 - v1-completions-path 2026-10-30T04:51:56.896542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:08.466024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:12.219824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:52:15.646Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ee66a2b0-c174-461e-9753-fa8886e33acc" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:60684 - v1-completions-path 2026-10-30T04:52:27.381979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:37.977318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:40.530007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:52:47.322069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:52:47.322108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:52:47.322123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:52:47.322128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:52:47.244Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 77 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "bbf8ad23-7322-416f-8dbe-6eaebd4a5550" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.134.1.25:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.33:48548 10.132.1.33:443 10.132.0.20:60196 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:53:00.754120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:05.267218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:08.221317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:53:15.180Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ec5f56b1-1635-4a6f-9a41-9df68478045b" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:56800 - v1-completions-path [2026-10-30T04:53:15.435Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "5ad76d24-edaa-4bc4-9411-2e4162d3d64a" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:56812 - v1-completions-path [2026-10-30T04:53:15.981Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1b377339-6612-4865-bf3f-c7bc67ec1058" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:49132 10.132.1.33:443 10.132.0.20:56826 - v1-completions-path [2026-10-30T04:53:16.529Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "5badc6b4-711f-4d6d-86f7-0082a142b259" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:56836 - v1-completions-path [2026-10-30T04:53:17.604Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "20e16f7f-46fa-4b5b-9056-64cf8af52bb5" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:33480 - v1-completions-path [2026-10-30T04:53:17.785Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4e182022-1daa-4daa-97d5-44c029b61da8" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:49132 10.132.1.33:443 10.132.0.20:33496 - v1-completions-path [2026-10-30T04:53:18.344Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7e9f829c-fb75-4f03-909b-5208ae147738" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:33794 10.132.1.33:443 10.132.0.20:33510 - v1-completions-path 2026-10-30T04:53:31.093810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:41.469508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:45.956344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:48.991906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:53:53.996787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:53:59.968Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 69 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e5daa57c-6324-499e-9cd2-970aed8747d8" "maas.apps.d36a3d177388305ff350.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.33:49132 10.132.1.33:443 10.132.0.20:49450 - v1-completions-path 2026-10-30T04:54:12.283010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:22.501124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:24.809400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:34.253402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:39.063498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:54:55.521053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:55:15.322786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:55:26.563873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:55:46.176183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:55:56.656158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:06.844265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:18.153150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:28.441956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:38.782748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:56:49.138793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9