2026-10-31T13:23:09.451550Z info FLAG: --concurrency="0" 2026-10-31T13:23:09.451569Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T13:23:09.451574Z info FLAG: --help="false" 2026-10-31T13:23:09.451576Z info FLAG: --log_as_json="false" 2026-10-31T13:23:09.451579Z info FLAG: --log_caller="" 2026-10-31T13:23:09.451581Z info FLAG: --log_output_level="default:info" 2026-10-31T13:23:09.451583Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T13:23:09.451587Z info FLAG: --log_target="[stdout]" 2026-10-31T13:23:09.451589Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T13:23:09.451606Z info FLAG: --outlierLogPath="" 2026-10-31T13:23:09.451608Z info FLAG: --profiling="true" 2026-10-31T13:23:09.451610Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T13:23:09.451612Z info FLAG: --proxyLogLevel="warning" 2026-10-31T13:23:09.451614Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T13:23:09.451616Z info FLAG: --stsPort="0" 2026-10-31T13:23:09.451618Z info FLAG: --templateFile="" 2026-10-31T13:23:09.451620Z info FLAG: --tokenManagerPlugin="" 2026-10-31T13:23:09.451622Z info FLAG: --vklog="0" 2026-10-31T13:23:09.451625Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T13:23:09.451775Z info Proxy role ips=[10.132.0.36] type=router id=maas-default-gateway-openshift-default-5d84bc6b95-hdtr7.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T13:23:09.451825Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T13:23:09.452903Z info cpu limit detected as 2, setting concurrency 2026-10-31T13:23:09.453518Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T13:23:09.453530Z info JWT policy is third-party-jwt 2026-10-31T13:23:09.453533Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T13:23:09.454893Z info Starting default Istio SDS Server 2026-10-31T13:23:09.454914Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T13:23:09.454932Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T13:23:09.455291Z info Opening status port 15020 2026-10-31T13:23:09.456909Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T13:23:09.457647Z info sds Starting SDS grpc server 2026-10-31T13:23:09.457659Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T13:23:09.458904Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T13:23:09.460052Z info Starting proxy agent 2026-10-31T13:23:09.460094Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T13:23:09.502541Z info cache generated new workload certificate resourceName=default latency=46.179265ms ttl=23h59m59.497463322s 2026-10-31T13:23:09.502585Z info cache Root cert has changed, start rotating root cert 2026-10-31T13:23:09.502657Z info cache returned workload trust anchor from cache ttl=23h59m59.497344261s 2026-10-31T13:23:09.523447Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T13:23:09.622355Z info ads ADS: new connection for node:1 2026-10-31T13:23:09.622431Z info cache returned workload certificate from cache ttl=23h59m59.377571585s 2026-10-31T13:23:09.622480Z info ads ADS: new connection for node:2 2026-10-31T13:23:09.622546Z info cache returned workload trust anchor from cache ttl=23h59m59.377454794s 2026-10-31T13:23:09.681291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:16.076942Z info Readiness succeeded in 6.628027736s 2026-10-31T13:23:16.077219Z info Envoy proxy is ready 2026-10-31T13:23:17.959455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:19.670998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:24.856898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:26.701823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:28.750564Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:30.887786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:33.628118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:36.164283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:52.804785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:53.414447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:26:48.136054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:26:48.136091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:26:48.136106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:26:48.136111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T13:26:48.050Z] "DELETE /v1/api-keys/3a0eb2ea-5f8a-4b96-a3a5-22c99328386c HTTP/1.1" 200 - via_upstream - "-" 0 321 85 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "7c7f4baa-38cb-4767-8b07-d4bbce9464ff" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:58516 10.132.0.36:443 10.133.0.12:60452 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:26:48.483685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:26:48.483717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:26:48.483731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T13:26:48.483736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T13:26:48.568232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:26:48.568266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:26:48.568280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:26:48.568284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T13:26:48.385Z] "DELETE /v1/api-keys/a4c010cc-f510-43fa-9a37-9ce39f5efc18 HTTP/1.1" 200 - via_upstream - "-" 0 321 98 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "ca8cf849-0901-4bdb-bc8a-e57c86e019b9" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:58518 10.132.0.36:443 10.133.0.12:60456 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:26:48.508Z] "DELETE /v1/api-keys/5ef0d7c7-5cbe-41e1-8c0f-5254ef2ab3e9 HTTP/1.1" 200 - via_upstream - "-" 0 321 59 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "de22d7b9-6840-474e-9658-177779b529cd" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:58516 10.132.0.36:443 10.133.0.12:60472 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:26:48.952Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 48 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "d157b138-148b-4bca-9f34-65b4ed9bc839" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.36:443 10.133.0.12:60488 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:27:08.633Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 86 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "b595e48c-cf1c-47ee-9cc1-845afc302d63" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:42996 10.132.0.36:443 10.133.0.12:33678 - v1-completions-path 2026-10-31T13:27:11.171395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:27:27.380540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:30:18.299165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:30:18.299198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:30:18.299210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:30:18.299215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:30:18.299375Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-10-31T13:30:18.299429Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T13:30:18.299437Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T13:30:18.299439Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T13:30:18.299443Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T13:30:17.718Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 580 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "566e3285-278b-4f5a-b8c6-ba0fdcf9b205" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:34440 10.132.0.36:443 10.133.0.12:42660 - v1-completions-path [2026-10-31T13:30:21.822Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 9 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "9c6a6bbb-13cd-9ae7-ae64-55d44609e4d2" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.36:443 10.133.0.12:42676 - - 2026-10-31T13:31:58.436676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:32:34.229217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:34:36.825155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:35:22.996259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:37:03.910226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:56:09.192524Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T14:04:53.663264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:16.251446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:59.086231Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T14:05:59.086264Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T14:05:59.086268Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T14:05:59.086272Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T14:05:59.053Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 32 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "58f53cd5-8f21-40dc-a280-1e6538fb4ba8" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.12:54854 - v1-completions-path 2026-10-31T14:06:01.440107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:06:04.897Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "ac6f2727-d4bb-44aa-9d60-0ce8b53ddb75" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:39766 10.132.0.36:443 10.133.0.12:54868 - v1-completions-path 2026-10-31T14:06:17.243982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:19.228358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:06:26.572Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "d5b7aa86-11fa-4549-9b4f-80f9f0c7f2e1" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.12:37444 - v1-completions-path 2026-10-31T14:06:38.301767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:40.022450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:42.931172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:51.285916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:58.169500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T14:06:58.498787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T14:06:58.105Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "b654fb81-35e1-410f-a05b-79c2391fe23a" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:47390 10.132.0.36:443 10.133.0.12:52724 - v1-completions-path [2026-10-31T14:06:58.446Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 56 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "f0616c52-a451-4ef0-8d5d-7d1d2099e2da" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:39766 10.132.0.36:443 10.133.0.12:52736 - v1-completions-path [2026-10-31T14:06:58.560Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "d6328d91-ba19-42c4-bd46-cedeea4d92fb" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:39766 10.132.0.36:443 10.133.0.12:52742 - v1-completions-path [2026-10-31T14:06:59.605Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "ccc4afda-9d3d-4383-84f1-e27deed7f2eb" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:47390 10.132.0.36:443 10.133.0.12:52772 - v1-completions-path [2026-10-31T14:06:59.716Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "2a92074b-ce46-48b3-9b36-7383fcc16563" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:47390 10.132.0.36:443 10.133.0.12:52780 - v1-completions-path 2026-10-31T14:07:15.717740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:25.931504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:27.755398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:07:33.477Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "ac5a70d8-274b-46e6-963d-1625d9533c22" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:39766 10.132.0.36:443 10.133.0.12:42706 - v1-completions-path [2026-10-31T14:07:34.594Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "33af7835-6181-47bc-a64f-609db346bd1d" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:47390 10.132.0.36:443 10.133.0.12:42720 - v1-completions-path 2026-10-31T14:07:46.825385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:48.651370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:55.460663Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T14:08:05.068817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:07.496462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:23.957552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:25.694363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:08:40.924Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 72 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "7f12ae10-385a-4e77-b05f-5060bf6ebc9a" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:34440 10.132.0.36:443 10.133.0.12:44778 - v1-completions-path 2026-10-31T14:08:41.934074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:52.545478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:55.264868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:09:02.237Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 64 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "c1b0ebc9-d96e-406b-9160-c31fef886e83" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:42996 10.132.0.36:443 10.133.0.12:60656 - v1-completions-path [2026-10-31T14:09:16.938Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "894b8bb1-cd98-468e-ba10-1f0660e05396" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.12:42746 - v1-completions-path 2026-10-31T14:09:21.091945Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:39.426621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:49.722441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:53.915563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:09:53.915615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:09:53.915631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T14:09:53.915636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T14:09:53.835Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 80 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "0a4a6a43-90c5-44e5-8ef0-aaa345398206" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:41018 10.132.0.36:443 10.133.0.12:36050 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:10:06.032429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:10:08.916178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:11:49.831673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:11:52.709480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:13:25.294414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:13:40.408558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:13:42.299878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:14:01.468609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:15:30.257608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:15:46.723765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:01.716148Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:13.527273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:17.184957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:28.086032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:30.118537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:16:37.942Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "9458834b-bca4-4837-a8bb-dbece36c2cf9" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.12:39926 - v1-completions-path 2026-10-31T14:16:49.689073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:19:38.678542Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T14:19:38.678569Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T14:19:38.678573Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T14:19:38.678576Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T14:19:38.621Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 57 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "fc79105c-f068-44dc-a146-90abf2f655cc" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.12:59306 - v1-catch-all-path 2026-10-31T14:19:40.653466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:19:45.855963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:20:00.995450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:20:02.742126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:20:17.008474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:20:27.896853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8