2026-11-02T13:53:03.039473Z info FLAG: --concurrency="0" 2026-11-02T13:53:03.039493Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T13:53:03.039498Z info FLAG: --help="false" 2026-11-02T13:53:03.039501Z info FLAG: --log_as_json="false" 2026-11-02T13:53:03.039505Z info FLAG: --log_caller="" 2026-11-02T13:53:03.039507Z info FLAG: --log_output_level="default:info" 2026-11-02T13:53:03.039510Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T13:53:03.039516Z info FLAG: --log_target="[stdout]" 2026-11-02T13:53:03.039519Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T13:53:03.039523Z info FLAG: --outlierLogPath="" 2026-11-02T13:53:03.039525Z info FLAG: --profiling="true" 2026-11-02T13:53:03.039529Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T13:53:03.039531Z info FLAG: --proxyLogLevel="warning" 2026-11-02T13:53:03.039534Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T13:53:03.039536Z info FLAG: --stsPort="0" 2026-11-02T13:53:03.039539Z info FLAG: --templateFile="" 2026-11-02T13:53:03.039542Z info FLAG: --tokenManagerPlugin="" 2026-11-02T13:53:03.039545Z info FLAG: --vklog="0" 2026-11-02T13:53:03.039549Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T13:53:03.039742Z info Proxy role ips=[10.134.0.35] type=router id=maas-default-gateway-openshift-default-8b64f9ff9-drgtc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T13:53:03.039805Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T13:53:03.040911Z info cpu limit detected as 2, setting concurrency 2026-11-02T13:53:03.041116Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T13:53:03.041130Z info JWT policy is third-party-jwt 2026-11-02T13:53:03.041134Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T13:53:03.042320Z info Starting default Istio SDS Server 2026-11-02T13:53:03.042349Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T13:53:03.042380Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T13:53:03.043396Z info Opening status port 15020 2026-11-02T13:53:03.043757Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T13:53:03.045319Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T13:53:03.046428Z info Starting proxy agent 2026-11-02T13:53:03.046462Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T13:53:03.054837Z info sds Starting SDS grpc server 2026-11-02T13:53:03.054854Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T13:53:03.114465Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T13:53:03.138995Z info cache generated new workload certificate resourceName=default latency=94.768086ms ttl=23h59m59.861010344s 2026-11-02T13:53:03.139073Z info cache Root cert has changed, start rotating root cert 2026-11-02T13:53:03.139123Z info cache returned workload trust anchor from cache ttl=23h59m59.860888448s 2026-11-02T13:53:03.215504Z info ads ADS: new connection for node:1 2026-11-02T13:53:03.215610Z info cache returned workload certificate from cache ttl=23h59m59.784392089s 2026-11-02T13:53:03.216099Z info ads ADS: new connection for node:2 2026-11-02T13:53:03.216170Z info cache returned workload trust anchor from cache ttl=23h59m59.783831203s 2026-11-02T13:53:03.317418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:53:11.191536Z info Readiness succeeded in 8.154690372s 2026-11-02T13:53:11.192010Z info Envoy proxy is ready 2026-11-02T13:53:23.936917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:53:23.936954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:53:23.936968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:53:23.936972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T13:53:23.821Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 115 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "9a0a5f85-c686-4660-99de-e35d1bc56acc" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.35:34902 10.134.0.35:443 10.132.0.22:48480 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T13:53:24.373Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 320 77 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "7b7b0192-dcaa-4e5b-855d-d686020c7dc1" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:58244 10.134.0.35:443 10.132.0.22:48486 - v1-model-routing [2026-11-02T13:53:24.513Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 337 55 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "95221203-c929-48ce-9ad3-a4ee935f6df1" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:58244 10.134.0.35:443 10.132.0.22:48496 - v1-model-routing [2026-11-02T13:53:24.632Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 522 61 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "083d36d1-ba52-41a9-9209-c993a54e21ad" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:58244 10.134.0.35:443 10.132.0.22:48506 - v1-model-routing [2026-11-02T13:53:24.892Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 61 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "b313ccf9-d629-431c-8815-0397de06f1a6" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.35:443 10.132.0.22:48508 - v1-model-routing 2026-11-02T13:53:25.857029Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T13:53:25.863468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:53:25.863509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:53:25.863528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:53:25.863534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T13:53:25.169Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 62 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "b9c617d8-cf64-4389-9a18-1b7ce3864bc0" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.35:443 10.132.0.22:48520 - v1-model-routing [2026-11-02T13:53:25.572Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 62 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "531dea6a-a2b6-405a-ae92-7cfea36005ea" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.35:443 10.132.0.22:48534 - v1-model-routing [2026-11-02T13:53:25.790Z] "DELETE /v1/api-keys/9827e5db-fa2e-4a9f-8c17-470b06d72beb HTTP/1.1" 200 - via_upstream - "-" 0 365 72 - "34.228.250.194,10.132.0.22" "curl/7.76.1" "da3ca207-e36d-4998-93c1-ff0436537f1e" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.35:34916 10.134.0.35:443 10.132.0.22:48538 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:56:01.371260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:56:01.371295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:56:01.371308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:56:01.371313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:56:01.779498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:56:01.779534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:56:01.779548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:56:01.779553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T13:56:01.299Z] "DELETE /v1/api-keys/908dbd2a-7e5c-46e4-a40d-6759f138047c HTTP/1.1" 200 - via_upstream - "-" 0 321 72 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "a0e857d6-3826-47eb-87cf-723746bd3b7c" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.35:39302 10.134.0.35:443 10.132.0.22:34620 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T13:56:01.427Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 45 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "4cfc5cf1-4407-40f2-b3c0-df774a9dde3e" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.35:443 10.132.0.22:34632 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T13:56:01.710Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 69 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "102bad77-9645-4775-8102-d29f2fe5f6ce" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.35:39302 10.134.0.35:443 10.132.0.22:34646 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:56:02.630842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:56:02.630878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:56:02.630893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T13:56:02.630898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:56:03.033245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:56:03.033282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T13:56:03.033298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:56:03.033302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T13:56:02.537Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 93 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "2d0d16f7-94f0-4362-81f5-cc17387e600d" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.35:39318 10.134.0.35:443 10.132.0.22:34656 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T13:56:02.970Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 62 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "7dc5f2bd-4fcd-4121-ac6f-8fd275f9c82f" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.35:39302 10.134.0.35:443 10.132.0.22:34666 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T13:56:15.280102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:32.449191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:06.950773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:28.598650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:39.448227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:01:39.448264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:01:39.448275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:01:39.448280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:01:39.384Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 63 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "549650e1-61b1-40db-9970-4aa276f7bdae" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.35:52620 10.134.0.35:443 10.132.0.22:55188 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:02:20.930257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:02:46.179251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:02:48.011208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:07.007586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:09.073714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:11.831930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:19.950330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:44.224844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:54.470200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:03:56.458278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:04:02.143Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 75 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "6794d63a-ec18-47c2-936d-132840fda3ac" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:44768 10.134.0.35:443 10.132.0.22:49814 - v1-completions-path [2026-11-02T14:04:02.690Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "1139055b-cd25-4df1-b214-17ce10ff5546" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:44768 10.134.0.35:443 10.132.0.22:49824 - v1-completions-path [2026-11-02T14:04:02.812Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ff470df0-2652-4157-a3cb-1c3dcfec0189" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:44774 10.134.0.35:443 10.132.0.22:49830 - v1-completions-path [2026-11-02T14:04:03.406Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 56 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "ecc746b4-f439-471f-a725-06ffcbd3d8ea" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:44774 10.134.0.35:443 10.132.0.22:49842 - v1-completions-path 2026-11-02T14:04:15.406286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:04:17.232436Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:04:21.960Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 290 78 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "d0a15241-d2b7-468d-b95f-942cf1ef5d0d" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:50080 10.134.0.35:443 10.132.0.22:47026 - v1-completions-path 2026-11-02T14:04:33.631551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:04:35.950375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:04:52.392703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:05:05.176151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:05:19.168273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:05:29.781022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:05:32.383076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:05:39.385814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:05:39.385851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:05:39.385866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T14:05:39.385872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T14:05:39.319Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 66 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "3df5a4d1-3519-40c3-8a79-1e6a5b18d9ee" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.35:53672 10.134.0.35:443 10.132.0.22:55488 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T14:05:51.103356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:05:52.835555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:06:05.113708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:06:23.303266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:06:33.460972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:07:01.809095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:07:04.822724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:10:32.640869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:10:47.745508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:10:49.520306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:10:54.793160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T14:10:54.732Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 69 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "09602116-8396-450e-96a4-815b83aa856d" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:54622 10.134.0.35:443 10.132.0.22:50092 - v1-completions-path 2026-11-02T14:11:06.552393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:12:57.728085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:13:12.385292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:13:28.007421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:13:39.924619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:13:43.663261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:13:52.422095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:13:54.999670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:14:01.102428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T14:14:01.047Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "c7330372-fa18-4000-8f35-ea7267ee1119" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.35:443 10.132.0.22:53242 - v1-completions-path 2026-11-02T14:14:12.678026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:17:16.013639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:17:21.146703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:17:24.351906Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-02T14:17:24.275Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 76 - "34.228.250.194,10.132.0.22" "python-requests/2.34.2" "19fd03f2-4f1d-47e8-8519-131de6dff5d4" "maas.apps.cb5bd2207f28ba92f278.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.35:52914 10.134.0.35:443 10.132.0.22:53466 - v1-catch-all-path 2026-11-02T14:17:36.365450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:17:38.031095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:17:52.338875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:18:03.141766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8