2026-10-31T13:22:25.862061Z info FLAG: --concurrency="0" 2026-10-31T13:22:25.862080Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T13:22:25.862084Z info FLAG: --help="false" 2026-10-31T13:22:25.862087Z info FLAG: --log_as_json="false" 2026-10-31T13:22:25.862089Z info FLAG: --log_caller="" 2026-10-31T13:22:25.862091Z info FLAG: --log_output_level="default:info" 2026-10-31T13:22:25.862093Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T13:22:25.862097Z info FLAG: --log_target="[stdout]" 2026-10-31T13:22:25.862100Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T13:22:25.862102Z info FLAG: --outlierLogPath="" 2026-10-31T13:22:25.862104Z info FLAG: --profiling="true" 2026-10-31T13:22:25.862106Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T13:22:25.862108Z info FLAG: --proxyLogLevel="warning" 2026-10-31T13:22:25.862110Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T13:22:25.862112Z info FLAG: --stsPort="0" 2026-10-31T13:22:25.862114Z info FLAG: --templateFile="" 2026-10-31T13:22:25.862116Z info FLAG: --tokenManagerPlugin="" 2026-10-31T13:22:25.862118Z info FLAG: --vklog="0" 2026-10-31T13:22:25.862121Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T13:22:25.862267Z info Proxy role ips=[10.133.0.32] type=router id=maas-default-gateway-openshift-default-5d84bc6b95-2fpt9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T13:22:25.862333Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T13:22:25.863593Z info cpu limit detected as 2, setting concurrency 2026-10-31T13:22:25.863825Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T13:22:25.863838Z info JWT policy is third-party-jwt 2026-10-31T13:22:25.863843Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T13:22:25.865709Z info Starting default Istio SDS Server 2026-10-31T13:22:25.865981Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T13:22:25.866010Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T13:22:25.866839Z info Opening status port 15020 2026-10-31T13:22:25.867128Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T13:22:25.867911Z info sds Starting SDS grpc server 2026-10-31T13:22:25.867933Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T13:22:25.868728Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T13:22:25.869686Z info Starting proxy agent 2026-10-31T13:22:25.869715Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T13:22:25.937465Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T13:22:25.940286Z info cache generated new workload certificate resourceName=default latency=72.197302ms ttl=23h59m59.059719514s 2026-10-31T13:22:25.940342Z info cache Root cert has changed, start rotating root cert 2026-10-31T13:22:25.940387Z info cache returned workload trust anchor from cache ttl=23h59m59.059615957s 2026-10-31T13:22:26.029286Z info ads ADS: new connection for node:1 2026-10-31T13:22:26.029398Z info cache returned workload certificate from cache ttl=23h59m58.970604541s 2026-10-31T13:22:26.029930Z info ads ADS: new connection for node:2 2026-10-31T13:22:26.030018Z info cache returned workload trust anchor from cache ttl=23h59m58.969982949s 2026-10-31T13:22:26.082029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:22:32.064576Z info Readiness succeeded in 6.205232171s 2026-10-31T13:22:32.064899Z info Envoy proxy is ready 2026-10-31T13:23:17.966855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:19.675178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:24.867221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:26.684165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:28.744357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:30.873586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:33.644273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:36.195782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:52.842676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:23:53.405084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:24:28.242Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 446 78 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "f4de0db2-c5a5-4512-9eee-b10222f4ac61" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:45022 10.133.0.32:443 10.133.0.12:57250 - v1-model-routing [2026-10-31T13:24:29.150Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 50 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "d2dec66c-7f8f-430b-8d8c-196f78e3875b" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.32:443 10.133.0.12:57264 - v1-model-routing 2026-10-31T13:26:48.326673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:26:48.326710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:26:48.326728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:26:48.326735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T13:26:48.258Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 68 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "3635152b-c79b-453c-a86b-7db81fafa667" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:54116 10.133.0.32:443 10.133.0.12:52776 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:26:49.591327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:26:49.591384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:26:49.591408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:26:49.591416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T13:26:49.762388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:26:49.762433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:26:49.762454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T13:26:49.762462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T13:26:49.487Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 104 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "8bfbf489-3e38-4a93-8cd3-8ddc6db677af" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:54132 10.133.0.32:443 10.133.0.12:52786 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T13:26:49.682Z] "DELETE /v1/api-keys/893850be-82da-4dbf-80fd-88606a1f5fc1 HTTP/1.1" 200 - via_upstream - "-" 0 321 79 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "988b5612-6202-45a8-aec9-987e2bbf53f5" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:54132 10.133.0.32:443 10.133.0.12:52788 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:26:55.370029Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-31T13:26:55.370055Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-31T13:26:55.370058Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-31T13:26:55.370062Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-10-31T13:26:55.336Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 33 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "e61616ea-0a93-466c-89e1-3edff266fa52" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.32:443 10.133.0.12:52814 - v1-completions-path [2026-10-31T13:26:58.147Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 110 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "0aebe574-2d00-4321-b6aa-e01dc8cdd718" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:45022 10.133.0.32:443 10.133.0.12:55498 - v1-completions-path 2026-10-31T13:27:11.119935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:27:27.349167Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T13:30:17.412Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 4633 240 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "bffded39-b956-4a01-ab1d-554f74717a72" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:48262 10.133.0.32:443 10.133.0.12:40062 - v1-chat-completions-path 2026-10-31T13:30:58.774211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:30:58.774246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:30:58.774263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T13:30:58.774268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:30:58.774275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T13:30:58.708Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 65 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "e59e509a-df17-4c9e-b622-799444bfdd11" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:47902 10.133.0.32:443 10.133.0.12:33574 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T13:31:58.535162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:32:34.182627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:34:36.820129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:35:23.084920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:37:04.003243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T13:54:30.458049Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T13:56:35.033038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:35.033082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:35.033101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T13:56:35.033108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T13:56:34.936Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 97 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "c19cd764-460e-457e-a054-ea892cfe260f" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:45594 10.133.0.32:443 10.133.0.12:43006 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:04:53.674826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:04:54.145272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:04:54.145341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:04:54.145360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:04:54.145365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T14:04:54.070Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 74 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "5a2d6695-d806-4477-a7cc-0a42fa7ebbe3" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:44998 10.133.0.32:443 10.133.0.12:40620 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:05:16.258972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:05:27.790488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:27.790520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:27.790532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:05:27.790537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T14:05:27.726Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 64 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "9ada1707-d490-4255-a6e4-5df9177fed08" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:44998 10.133.0.32:443 10.133.0.12:58942 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:06:01.462193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:06:05.430Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "1c9c785c-47cc-4102-86a0-92ccff228c25" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:38508 10.133.0.32:443 10.133.0.12:35962 - v1-completions-path 2026-10-31T14:06:17.258795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:19.224071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:38.314784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:40.010499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:42.709176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:51.251652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:06:57.373658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-10-31T14:06:57.310Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 64 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "0dc5ee41-daa5-4918-8383-a0344529d9cf" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:42794 10.133.0.32:443 10.133.0.12:35356 - v1-completions-path [2026-10-31T14:06:57.883Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "c9c1eeac-82f8-418b-a7e6-e6e57c9decd6" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:38508 10.133.0.32:443 10.133.0.12:35358 - v1-completions-path [2026-10-31T14:06:58.912Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "9ff78906-3255-42bd-b12f-0a2553c9cfe2" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:38508 10.133.0.32:443 10.133.0.12:35376 - v1-completions-path 2026-10-31T14:07:15.739124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:25.947983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:27.760783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:07:33.853Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "7f94b3dd-268a-4824-a115-03646145ca4d" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:42794 10.133.0.32:443 10.133.0.12:39976 - v1-completions-path 2026-10-31T14:07:46.834928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:48.645758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:07:55.035069Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-31T14:08:05.072011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:07.512331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:23.953345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:25.652089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:41.952513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:52.574040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:08:55.280535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:17.094025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:09:17.094057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:09:17.094070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:09:17.094075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T14:09:16.821Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 61 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "30962c7a-650f-4af1-be2a-8fe1626433da" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:45022 10.133.0.32:443 10.133.0.12:33404 - v1-completions-path [2026-10-31T14:09:17.028Z] "DELETE /v1/api-keys/9b77145e-f0d2-4737-93df-74df2fa17b4e HTTP/1.1" 404 - via_upstream - "-" 0 29 66 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "113d73f3-7df6-95aa-b2ac-bd9322ea0784" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:53226 10.133.0.32:443 10.133.0.12:33416 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:09:21.091333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:39.446435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:09:49.723215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:10:06.072415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:10:08.933169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:11:49.845852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:11:52.712762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:13:25.317434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:13:40.404076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:13:42.298766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:14:01.497734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:15:24.977023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:15:24.977059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:15:24.977074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T14:15:24.977079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T14:15:25.384750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T14:15:25.384786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T14:15:25.384800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T14:15:25.384805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-31T14:15:24.900Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 326 76 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "bac5a6f6-5c8e-4e44-99d6-e6dbade4ec40" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:44074 10.133.0.32:443 10.133.0.12:48062 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T14:15:25.330Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 53 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "9d7fafa2-e9d5-4aa9-a656-56208d47623f" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.133.0.54:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.32:44076 10.133.0.32:443 10.133.0.12:48086 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T14:15:30.281237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:15:46.755960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:01.756462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:13.528941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:17.190144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:28.110876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:16:30.100216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T14:16:37.614Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "34.228.250.194,10.133.0.12" "python-requests/2.34.2" "6d3e320d-2318-46b9-a55e-60b4ea46c5b7" "maas.apps.eea73e210ab98c75620c.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:38508 10.133.0.32:443 10.133.0.12:35570 - v1-completions-path 2026-10-31T14:16:49.666382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:19:40.676807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:19:45.872845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:20:01.017752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:20:02.742687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:20:17.004911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T14:20:27.906866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8