2026-11-03T03:17:03.476911Z info FLAG: --concurrency="0" 2026-11-03T03:17:03.476940Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T03:17:03.476944Z info FLAG: --help="false" 2026-11-03T03:17:03.476946Z info FLAG: --log_as_json="false" 2026-11-03T03:17:03.476948Z info FLAG: --log_caller="" 2026-11-03T03:17:03.476950Z info FLAG: --log_output_level="default:info" 2026-11-03T03:17:03.476952Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T03:17:03.476956Z info FLAG: --log_target="[stdout]" 2026-11-03T03:17:03.476959Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T03:17:03.476961Z info FLAG: --outlierLogPath="" 2026-11-03T03:17:03.476963Z info FLAG: --profiling="true" 2026-11-03T03:17:03.476965Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T03:17:03.476967Z info FLAG: --proxyLogLevel="warning" 2026-11-03T03:17:03.476969Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T03:17:03.476971Z info FLAG: --stsPort="0" 2026-11-03T03:17:03.476973Z info FLAG: --templateFile="" 2026-11-03T03:17:03.476975Z info FLAG: --tokenManagerPlugin="" 2026-11-03T03:17:03.476978Z info FLAG: --vklog="0" 2026-11-03T03:17:03.476980Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T03:17:03.477121Z info Proxy role ips=[10.133.1.38] type=router id=maas-default-gateway-openshift-default-5bc884dd87-sl8s8.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T03:17:03.477167Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T03:17:03.478386Z info cpu limit detected as 2, setting concurrency 2026-11-03T03:17:03.478629Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T03:17:03.478640Z info JWT policy is third-party-jwt 2026-11-03T03:17:03.478643Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T03:17:03.480598Z info Starting default Istio SDS Server 2026-11-03T03:17:03.480624Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T03:17:03.480656Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T03:17:03.481111Z info Opening status port 15020 2026-11-03T03:17:03.481891Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T03:17:03.483280Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T03:17:03.484155Z info Starting proxy agent 2026-11-03T03:17:03.484217Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T03:17:03.492311Z info sds Starting SDS grpc server 2026-11-03T03:17:03.492331Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T03:17:03.552243Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T03:17:03.719412Z info ads ADS: new connection for node:1 2026-11-03T03:17:03.719764Z info ads ADS: new connection for node:2 2026-11-03T03:17:03.740744Z info cache generated new workload certificate resourceName=default latency=258.940075ms ttl=23h59m59.259258946s 2026-11-03T03:17:03.740772Z info cache Root cert has changed, start rotating root cert 2026-11-03T03:17:03.740804Z info cache returned workload trust anchor from cache ttl=23h59m59.259196864s 2026-11-03T03:17:03.740823Z info cache returned workload certificate from cache ttl=23h59m59.259176849s 2026-11-03T03:17:03.740913Z info cache returned workload trust anchor from cache ttl=23h59m59.259089271s 2026-11-03T03:17:03.741182Z info cache returned workload trust anchor from cache ttl=23h59m59.258818493s 2026-11-03T03:17:03.842383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:17:11.801425Z info Readiness succeeded in 8.327435781s 2026-11-03T03:17:11.801746Z info Envoy proxy is ready 2026-11-03T03:17:26.461545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:17:29.080Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 147 412 113 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ec060e18-6ce5-46d3-98d5-c92f82abdf1b" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:49648 10.133.1.38:443 10.132.0.20:53096 - v1-chat-completions-path 2026-11-03T03:17:44.125400Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T03:17:44.125426Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T03:17:44.125429Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T03:17:44.125433Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T03:17:43.987Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 137 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e1a928f5-bc6b-4c40-8348-e28c26a5b7ab" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.38:443 10.132.0.20:54896 - v1-catch-all-path 2026-11-03T03:17:45.277494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:17:48.308669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:17:57.599848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:18:10.368480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:18:20.057407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:18:23.090972Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T03:18:23.013Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 77 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4a5fa806-af68-47f1-947a-a29bbdc29273" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:56770 10.133.1.38:443 10.132.0.20:38212 - v1-catch-all-path 2026-11-03T03:18:36.640004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:18:48.413117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:18:53.007689Z info ads ADS: new connection for node:3 2026-11-03T03:18:53.007933Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T03:18:53.008030Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T03:18:57.377220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:19:40.018889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:20:02.935Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 40 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "24315960-ecd2-4661-9769-c0413279e4b7" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-e934465c-inference-pool-ip-6641cb70.llm.svc.cluster.local - 10.133.1.38:443 10.132.0.20:45736 - v1-model-routing 2026-11-03T03:20:05.212048Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T03:20:05.262341Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:20:11.364037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:20:27.053920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:23:11.023526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:23:11.023566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:23:11.023580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:23:11.023585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T03:23:10.898Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 326 125 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "0960bd7c-eec5-4418-8500-583ea2be0f6b" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.38:39322 10.133.1.38:443 10.132.0.20:34240 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:23:23.070514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:23:47.542770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:24:13.553168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:24:28.866967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:24:37.078509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:24:49.961944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:24:54.542841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:24:58.469Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 90 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7d22653a-de29-431b-9390-a455bf5af471" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.38:443 10.132.0.20:40466 - v1-completions-path 2026-11-03T03:25:12.605174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:26:01.181380Z info ads ADS: new connection for node:4 2026-11-03T03:26:01.186551Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T03:26:01.186617Z info cache read certificate from file resource=file-root:system 2026-11-03T03:26:05.034697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:26:06.024998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:27:01.961870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:01.961906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:01.961919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:27:01.961925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:01.962141Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T03:27:01.764Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 197 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "eb13ade3-3e71-4e95-b2a9-ec4bfc6e1834" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.38:46280 10.133.1.38:443 10.132.0.20:35616 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:27:30.140349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T03:27:30.141149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:30.141179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:30.141219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:27:30.141227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:27:30.141408Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T03:27:30.008Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 133 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "f664ac6d-8b7e-4093-994a-0fa9502d3d8e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.38:46280 10.133.1.38:443 10.132.0.20:58028 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:27:46.940008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:46.940052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:46.940074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:46.940081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T03:27:46.827Z] "DELETE /v1/api-keys/4f9bc459-cd55-420e-86f5-684aa88ac696 HTTP/1.1" 200 - via_upstream - "-" 0 359 112 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "026eb594-f2dc-4533-901e-ef2bf980d02e" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.38:54732 10.133.1.38:443 10.132.0.20:32966 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:28:00.300223Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T03:28:00.343481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:28:02.812425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:28:13.126840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:28:15.831240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:28:15.831274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:28:15.831289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:28:15.831294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:28:16.496745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T03:28:15.702Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 129 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4d20628a-35bb-4bd8-943b-09b28f32e65c" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.38:56708 10.133.1.38:443 10.132.0.20:57182 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T03:28:16.043Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "bc9aabd4-3733-429e-90b2-217c129ec4e5" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:35826 10.133.1.38:443 10.132.0.20:57198 - v1-completions-path [2026-11-03T03:28:16.438Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c4f2ee66-1d06-4ffc-8a6e-6c6d4c93d383" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:35826 10.133.1.38:443 10.132.0.20:57206 - v1-completions-path 2026-11-03T03:28:31.618752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:28:35.971048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:28:39.438Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2a6755de-608b-4d4b-8556-41d618871975" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:48850 10.133.1.38:443 10.132.0.20:36296 - v1-completions-path [2026-11-03T03:28:41.301Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 56 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "9268a68e-eaa4-410d-a7a9-48fb6ae52193" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:35826 10.133.1.38:443 10.132.0.20:36314 - v1-completions-path [2026-11-03T03:28:41.797Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7dab155b-ae60-4cf2-809c-18632b545c38" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.38:443 10.132.0.20:36318 - v1-completions-path 2026-11-03T03:28:55.755698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:29:12.664552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:29:19.534627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:29:19.534663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:29:19.534679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:29:19.534684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T03:29:19.424Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 110 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "6f944427-d785-44c7-819e-caeadc500411" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.38:37744 10.133.1.38:443 10.132.0.20:58300 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:29:43.622952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:29:54.275613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:30:00.348366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:30:13.367Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "bf286919-297b-4d6c-a420-c9054478e003" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:48850 10.133.1.38:443 10.132.0.20:50684 - v1-completions-path 2026-11-03T03:30:30.326383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:30:34.938029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:30:35.582Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 295 104 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7f5e10df-16f1-4c45-8f1b-0e1adfd92ca8" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.56:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:59850 10.133.1.38:443 10.132.0.20:42288 - v1-completions-path 2026-11-03T03:30:47.587283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:30:56.227179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:31:05.181830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:31:14.022944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:31:22.917739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:31:41.066259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:31:43.995Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 79 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3b4b04b3-8021-400c-9751-e566d23392af" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:57866 10.133.1.38:443 10.132.0.20:50416 - v1-completions-path [2026-11-03T03:32:04.485Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 34 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2385df20-4546-4547-9b3c-94aad1db5f15" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.38:443 10.132.0.20:36668 - v1-completions-path 2026-11-03T03:32:12.397770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:32:32.713270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:32:43.406266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:35:35.793868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:37:07.367390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:37:24.525676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:37:29.340896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:37:41.922247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:37:59.454863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:38:05.905846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:38:08.616857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:38:08.616895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:38:08.616911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T03:38:08.616916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T03:38:06.633Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 1983 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "56125733-9368-41c7-bcbe-b8d93e3f4808" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.1.73:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.38:44436 10.133.1.38:443 10.132.0.20:42776 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:38:25.878083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:38:36.626787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:38:42.757376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T03:38:53.793Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a52a1d18-1290-4158-8ac4-6b09f2b85600" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:35826 10.133.1.38:443 10.132.0.20:54560 - v1-completions-path [2026-11-03T03:38:55.426Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "65dd6ed7-9210-4fef-9e94-b74c3f5839f7" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:35826 10.133.1.38:443 10.132.0.20:54568 - v1-completions-path 2026-11-03T03:39:10.058581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:39:16.234798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:39:21.941211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:39:29.230842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:39:29.230879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:39:29.230897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T03:39:29.230902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T03:39:29.112Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 118 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1dd5c953-309f-4f23-bebf-6ee1a0c9a236" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.151:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.38:57478 10.133.1.38:443 10.132.0.20:39080 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T03:39:30.982Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4990bcb6-751b-4d39-b308-06a9e4deb578" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:35826 10.133.1.38:443 10.132.0.20:35424 - v1-completions-path [2026-11-03T03:39:33.136Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "040e8aed-287f-4f6c-8e30-d1d1ba0c5ab7" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:35826 10.133.1.38:443 10.132.0.20:35434 - v1-completions-path [2026-11-03T03:39:33.849Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "fb0145d2-5ed8-4860-941e-eea41d0411e7" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:48850 10.133.1.38:443 10.132.0.20:35446 - v1-completions-path [2026-11-03T03:39:35.285Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "5eefe2ee-483e-47c5-ad3e-d3f5fe05671e" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.38:48850 10.133.1.38:443 10.132.0.20:35468 - v1-completions-path [2026-11-03T03:39:38.844Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "72de3c52-ee4f-4dd1-aa2f-7c7c246b0315" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.38:443 10.132.0.20:35472 - v1-completions-path 2026-11-03T03:39:52.956853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:40:03.813099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:40:10.170239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:40:16.010542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:40:26.267180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:40:48.804641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:40:59.604843Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:41:04.343349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:41:20.278845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:41:26.278409Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:41:50.122107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:42:12.181819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:42:32.446013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:42:45.126328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:43:05.013432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:43:15.704776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:43:26.556448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:43:37.347753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T03:43:47.866910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8