2026-10-30T03:53:20.710668Z info FLAG: --concurrency="0" 2026-10-30T03:53:20.710816Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T03:53:20.710841Z info FLAG: --help="false" 2026-10-30T03:53:20.710858Z info FLAG: --log_as_json="false" 2026-10-30T03:53:20.710874Z info FLAG: --log_caller="" 2026-10-30T03:53:20.710890Z info FLAG: --log_output_level="default:info" 2026-10-30T03:53:20.710906Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T03:53:20.710924Z info FLAG: --log_target="[stdout]" 2026-10-30T03:53:20.710940Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T03:53:20.710955Z info FLAG: --outlierLogPath="" 2026-10-30T03:53:20.710971Z info FLAG: --profiling="true" 2026-10-30T03:53:20.710986Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T03:53:20.711002Z info FLAG: --proxyLogLevel="warning" 2026-10-30T03:53:20.711017Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T03:53:20.711033Z info FLAG: --stsPort="0" 2026-10-30T03:53:20.711069Z info FLAG: --templateFile="" 2026-10-30T03:53:20.711085Z info FLAG: --tokenManagerPlugin="" 2026-10-30T03:53:20.711102Z info FLAG: --vklog="0" 2026-10-30T03:53:20.711118Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T03:53:20.711261Z info Proxy role ips=[10.134.1.10] type=router id=maas-default-gateway-openshift-default-645cf464d7-l52hr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T03:53:20.711326Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T03:53:20.712453Z info cpu limit detected as 2, setting concurrency 2026-10-30T03:53:20.712821Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T03:53:20.712882Z info JWT policy is third-party-jwt 2026-10-30T03:53:20.712908Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T03:53:20.714911Z info Starting default Istio SDS Server 2026-10-30T03:53:20.714986Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T03:53:20.715027Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T03:53:20.715880Z info Opening status port 15020 2026-10-30T03:53:20.717297Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T03:53:20.718370Z info sds Starting SDS grpc server 2026-10-30T03:53:20.718724Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T03:53:20.719202Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T03:53:20.720135Z info Starting proxy agent 2026-10-30T03:53:20.720220Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T03:53:20.810648Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T03:53:20.820391Z info cache generated new workload certificate resourceName=default latency=101.558278ms ttl=23h59m59.179612037s 2026-10-30T03:53:20.820422Z info cache Root cert has changed, start rotating root cert 2026-10-30T03:53:20.820452Z info cache returned workload trust anchor from cache ttl=23h59m59.179548721s 2026-10-30T03:53:20.947671Z info ads ADS: new connection for node:1 2026-10-30T03:53:20.947767Z info cache returned workload certificate from cache ttl=23h59m59.052236456s 2026-10-30T03:53:20.948471Z info ads ADS: new connection for node:2 2026-10-30T03:53:20.948564Z info cache returned workload trust anchor from cache ttl=23h59m59.051438129s 2026-10-30T03:53:21.042620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:53:29.446020Z info Readiness succeeded in 8.738247351s 2026-10-30T03:53:29.446463Z info Envoy proxy is ready 2026-10-30T03:53:49.943520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:53:53.272269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:53:53.272309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:53:53.272323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:53:53.272328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T03:53:53.178Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 303 93 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "9fac9358-f29b-43b9-9b61-26b71860152d" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:45202 10.134.1.10:443 10.132.0.13:53636 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:54:06.155911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:54:08.808291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:54:19.256937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:54:35.288263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:54:37.711613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:54:52.402656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:55:03.542811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:55:05.380942Z info ads ADS: new connection for node:3 2026-10-30T03:55:05.381127Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T03:55:05.381155Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T03:55:07.512094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:55:49.691498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T03:55:53.486Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 336 102 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "ea058e1a-8ee1-4746-a4b9-94433dbdfd32" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.1.67:8000" outbound|54321||e2e-prio-pool-0e6257a1-inference-pool-ip-0cbeffb6.llm.svc.cluster.local 10.134.1.10:57072 10.134.1.10:443 10.132.0.13:54368 - v1-model-routing [2026-10-30T03:55:56.229Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 327 64 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "a2cb7925-243d-4695-80b4-a724c3552149" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.1.67:8000" outbound|54321||e2e-prio-pool-0e6257a1-inference-pool-ip-0cbeffb6.llm.svc.cluster.local 10.134.1.10:57072 10.134.1.10:443 10.132.0.13:57530 - v1-model-routing 2026-10-30T03:56:08.994222Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T03:56:09.041035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:56:11.388355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:56:14.269349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:56:19.471526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:57:49.518928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:57:49.518970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:57:49.518988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T03:57:49.518993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T03:57:49.429Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 89 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "665f77ac-c8b5-47d0-b5c4-888952146a15" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:50168 10.134.1.10:443 10.132.0.13:58954 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:57:55.594975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:58:13.220855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:58:33.643509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:58:45.700999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:58:50.576149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:59:03.295659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:59:06.950887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:59:14.476260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:59:14.476297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:59:14.476314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:59:14.476320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T03:59:14.421Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 55 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "acd6ee23-eca1-47c8-ab3e-0e87c1222473" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:57800 10.134.1.10:443 10.132.0.13:43144 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:59:26.903513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T03:59:58.063Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 87 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "d15c17e1-2dde-49d7-a817-7ee97a857394" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:50168 10.134.1.10:443 10.132.0.13:45408 - v1-completions-path 2026-10-30T04:00:13.984735Z info ads ADS: new connection for node:4 2026-10-30T04:00:13.988561Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T04:00:13.988619Z info cache read certificate from file resource=file-root:system 2026-10-30T04:00:15.170141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:00:15.959906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:00:19.040454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:00:24.033964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T04:00:24.035394Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"139","StreamId":"13762776346078108115"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-10-30T04:00:23.959Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 76 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "467ade7b-cf66-4da4-86bf-5b87cfdd9658" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.1.10:443 10.132.0.13:36610 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-30T04:00:56.125115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:00:56.125154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:00:56.125170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:00:56.125176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:00:56.125399Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T04:00:56.006Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1728 119 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "1f8eb167-bc84-4386-9b96-8149f0f4e83f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.10:40654 10.134.1.10:443 10.132.0.13:39106 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:01:06.781398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:01:06.781436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:01:06.781448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:01:06.781453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:01:06.781615Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T04:01:06.684Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1725 97 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5a8a4462-016b-4734-9227-612c5af91069" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.10:40654 10.134.1.10:443 10.132.0.13:57618 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:01:19.619874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:01:19.619907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:01:19.619918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:01:19.619922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:01:19.620107Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T04:01:19.504Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1728 115 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "9ea0a11b-1e18-4310-997e-394483c35bcc" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.10:37860 10.134.1.10:443 10.132.0.13:49146 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:01:44.806214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:01:44.806252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:01:44.806267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:01:44.806272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:01:44.729Z] "DELETE /v1/api-keys/fcf6a7f7-1108-40df-85d0-deecc7395b2c HTTP/1.1" 200 - via_upstream - "-" 0 359 76 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "399531b9-a9bb-4d42-9a2e-cb66ec44986e" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:60138 10.134.1.10:443 10.132.0.13:52184 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:01:56.541328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:01:56.664149Z info ads ADS: "" 4 terminated 2026-10-30T04:01:56.895898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:01:56.895944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:01:56.895966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:01:56.895973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:01:57.231437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:01:56.805Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 90 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "ade60e1d-a3ff-4b33-92a6-fb5e4f79e6af" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.134.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:39444 10.134.1.10:443 10.132.0.13:51268 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:01:59.319142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:02:06.330632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:02:23.261433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:02:27.942757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:02:31.074Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 71 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "ad211502-35c7-4a0f-8217-59a54e30f362" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:52660 10.134.1.10:443 10.132.0.13:55082 - v1-completions-path [2026-10-30T04:02:31.324Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "721b4674-edfa-4839-a8fa-227083021e29" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.10:443 10.132.0.13:55090 - v1-completions-path 2026-10-30T04:02:43.401939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:02:59.194091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:03:04.623Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 63 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "b00d7dd8-4a10-4657-bb15-8b99a789a6fa" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:52660 10.134.1.10:443 10.132.0.13:38806 - v1-completions-path 2026-10-30T04:03:05.456442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T04:03:05.450Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "84b33d54-8200-4615-9dd0-714519b92ef8" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:56270 10.134.1.10:443 10.132.0.13:38822 - v1-completions-path [2026-10-30T04:03:06.028Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "77c5338f-4a6a-4ea3-a5c6-377021604b8f" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:52660 10.134.1.10:443 10.132.0.13:38832 - v1-completions-path [2026-10-30T04:03:06.184Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "4d2922b7-374e-4392-8d5b-9528cd575200" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:52660 10.134.1.10:443 10.132.0.13:38834 - v1-completions-path [2026-10-30T04:03:06.260Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "b0dac89f-81a8-469f-8432-fbd437459db5" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:56270 10.134.1.10:443 10.132.0.13:38850 - v1-completions-path [2026-10-30T04:03:06.334Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 56 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "64239544-5b5d-463b-99ac-06babd8f42c2" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:52660 10.134.1.10:443 10.132.0.13:38858 - v1-completions-path 2026-10-30T04:03:22.604919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:03:33.054138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:03:37.541457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:03:42.478Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5a96309c-acb6-4c1b-abbb-9b052c6ab452" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:56270 10.134.1.10:443 10.132.0.13:52404 - v1-completions-path 2026-10-30T04:03:54.751754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:03:57.067617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:04:04.480Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 289 80 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5276ffb4-7123-4728-bbee-d872a71d3b2d" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:49740 10.134.1.10:443 10.132.0.13:48370 - v1-completions-path 2026-10-30T04:04:16.475157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:04:18.472Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 73 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "ebce4473-af71-4a3d-8582-362150c5ae53" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:50168 10.134.1.10:443 10.132.0.13:48844 - v1-completions-path 2026-10-30T04:04:21.227102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:04:36.985842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:04:39.349425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:04:57.136901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:05:07.951683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:05:10.942801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:05:27.033Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 37 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "36e5a285-dc7d-469e-81ab-ee610c383969" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.10:443 10.132.0.13:54354 - v1-completions-path 2026-10-30T04:05:29.179017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:05:32.100479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:05:44.095484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:05:50.910Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 65 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "197816d0-6ad4-4a07-b651-41aed845c633" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:56270 10.134.1.10:443 10.132.0.13:33454 - v1-completions-path 2026-10-30T04:06:03.024299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:06:13.371313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:06:33.672687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:06:37.234637Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:08:20.847639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:08:24.267804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:09:54.540434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:09:57.008Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 288 158 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "b636e77a-2641-49c1-915e-22879a216e64" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:59580 10.134.1.10:443 10.132.0.13:36018 - v1-completions-path 2026-10-30T04:10:09.959023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:10:12.304597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:10:31.365628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:10:43.691578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:10:47.314332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:10:51.662878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:10:51.662916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:10:51.662933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:10:51.662938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:10:51.586Z] "DELETE /v1/api-keys/dede5198-c099-4685-b8c5-68241e3533bf HTTP/1.1" 200 - via_upstream - "-" 0 369 76 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "05523a6c-9af0-4cf4-9b35-3bd53c679072" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.132.1.57:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:58794 10.134.1.10:443 10.132.0.13:46772 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:11:03.196411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:11:13.409913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:11:18.555667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:11:22.604289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:11:22.604328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:11:22.604345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:11:22.604350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T04:11:22.520Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 83 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5bc88797-107b-4a8e-968f-cac08a293886" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.132.1.57:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:58794 10.134.1.10:443 10.132.0.13:46696 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:11:22.735Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 66 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "59e88628-23f5-4f6e-a203-32d37ba53bf0" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:52660 10.134.1.10:443 10.132.0.13:46728 - v1-completions-path [2026-10-30T04:11:23.111Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "4388d862-1927-47e7-994c-15c97040e429" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:56270 10.134.1.10:443 10.132.0.13:46738 - v1-completions-path 2026-10-30T04:11:36.156924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:11:40.569838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:11:44.178421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:11:50.219826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:11:50.219874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:11:50.219897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:11:50.219905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T04:11:50.139Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 80 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "cf054569-840e-469f-8848-fc7f9964afd3" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.132.1.57:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:36698 10.134.1.10:443 10.132.0.13:45882 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:11:51.408Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 64 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "450c0704-b500-426f-8175-fa422cc68c4c" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:52660 10.134.1.10:443 10.132.0.13:45896 - v1-completions-path [2026-10-30T04:11:51.591Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 59 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "e840751f-bfd7-4482-8d7c-d3cb96137a32" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:56270 10.134.1.10:443 10.132.0.13:45908 - v1-completions-path [2026-10-30T04:11:52.243Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "ec531794-d4a1-423d-a26b-9e1fd1575e94" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:56270 10.134.1.10:443 10.132.0.13:45924 - v1-completions-path 2026-10-30T04:12:07.227707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:17.546820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:22.169029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:25.630613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:28.496942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:12:28.496982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:12:28.496998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:12:28.497003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T04:12:28.413Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 83 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "be319159-f371-446d-954c-9b045f27fd1f" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.1.108:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.10:45442 10.134.1.10:443 10.132.0.13:53130 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:12:30.563752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:48.935742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:59.241182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:01.533105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:11.268304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:16.380558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:33.124127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:53.272721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:03.543758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:13.837584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:24.281902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:34.545536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:44.980801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:55.578734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:15:05.848295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:15:16.176834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:15:26.517212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:15:31.457498Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:15:31.457528Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:15:31.457532Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T04:15:31.457537Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T04:15:31.430Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 27 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "f19b0f77-58e0-4d21-af61-041f76c420c1" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.10:443 10.132.0.13:58670 - v1-completions-path [2026-10-30T04:15:36.062Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 74 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "a6fbbb0e-424e-44e6-b657-00c0ed9cf5e3" "maas.apps.de2b76ef3c818f346074.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.10:50168 10.134.1.10:443 10.132.0.13:56870 - v1-completions-path