2026-10-31T19:25:41.798455Z info FLAG: --concurrency="0" 2026-10-31T19:25:41.798494Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T19:25:41.798499Z info FLAG: --help="false" 2026-10-31T19:25:41.798503Z info FLAG: --log_as_json="false" 2026-10-31T19:25:41.798505Z info FLAG: --log_caller="" 2026-10-31T19:25:41.798509Z info FLAG: --log_output_level="default:info" 2026-10-31T19:25:41.798512Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T19:25:41.798520Z info FLAG: --log_target="[stdout]" 2026-10-31T19:25:41.798523Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T19:25:41.798526Z info FLAG: --outlierLogPath="" 2026-10-31T19:25:41.798529Z info FLAG: --profiling="true" 2026-10-31T19:25:41.798531Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T19:25:41.798534Z info FLAG: --proxyLogLevel="warning" 2026-10-31T19:25:41.798537Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T19:25:41.798540Z info FLAG: --stsPort="0" 2026-10-31T19:25:41.798543Z info FLAG: --templateFile="" 2026-10-31T19:25:41.798545Z info FLAG: --tokenManagerPlugin="" 2026-10-31T19:25:41.798549Z info FLAG: --vklog="0" 2026-10-31T19:25:41.798552Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T19:25:41.798723Z info Proxy role ips=[10.133.0.213] type=router id=maas-default-gateway-openshift-default-7f694df8bc-fs5lm.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T19:25:41.798779Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T19:25:41.799820Z info cpu limit detected as 2, setting concurrency 2026-10-31T19:25:41.800297Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T19:25:41.800316Z info JWT policy is third-party-jwt 2026-10-31T19:25:41.800320Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T19:25:41.802622Z info Starting default Istio SDS Server 2026-10-31T19:25:41.802607Z info Opening status port 15020 2026-10-31T19:25:41.802640Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T19:25:41.802664Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T19:25:41.803215Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T19:25:41.804568Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T19:25:41.805315Z info Starting proxy agent 2026-10-31T19:25:41.805351Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T19:25:41.814011Z info sds Starting SDS grpc server 2026-10-31T19:25:41.814034Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T19:25:41.868155Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T19:25:41.931184Z info cache generated new workload certificate resourceName=default latency=127.796727ms ttl=23h59m59.06881957s 2026-10-31T19:25:41.931225Z info cache Root cert has changed, start rotating root cert 2026-10-31T19:25:41.931264Z info cache returned workload trust anchor from cache ttl=23h59m59.068736614s 2026-10-31T19:25:42.074063Z info ads ADS: new connection for node:1 2026-10-31T19:25:42.079340Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T19:25:42.079392Z info cache read certificate from file resource=file-root:system 2026-10-31T19:25:42.104543Z info ads ADS: new connection for node:2 2026-10-31T19:25:42.104608Z info cache returned workload certificate from cache ttl=23h59m58.895394461s 2026-10-31T19:25:42.105004Z info ads ADS: new connection for node:3 2026-10-31T19:25:42.105072Z info cache returned workload trust anchor from cache ttl=23h59m58.894929225s 2026-10-31T19:25:42.203084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:25:50.285436Z info Readiness succeeded in 8.489633737s 2026-10-31T19:25:50.285743Z info Envoy proxy is ready [2026-10-31T19:26:12.922Z] "POST /llm/e2e-dft-4b0637/anything/e2e-dft-4b0637-0cb280 HTTP/1.1" 503 - - "-" 109 0 205 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "1825092e-badd-42ef-8867-e813a83c9012" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-4b0637.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:46274 - llm.external-model-e2e-dft-4b0637-d46eb2d8e6ff.2 [2026-10-31T19:27:17.325Z] "POST /llm/e2e-dft-4b0637/anything/e2e-dft-4b0637-0cb280 HTTP/1.1" 503 - - "-" 109 0 101 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "84a91412-d974-4802-b3f9-b6ffba192437" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-4b0637.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:46982 - llm.external-model-e2e-dft-4b0637-d46eb2d8e6ff.2 [2026-10-31T19:27:49.247Z] "POST /llm/e2e-dft-4b0637/anything/e2e-dft-4b0637-0cb280 HTTP/1.1" 503 - - "-" 109 0 98 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "0c0e7bc4-faa9-49ea-a90a-fa35147fdb25" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-4b0637.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:54864 - llm.external-model-e2e-dft-4b0637-d46eb2d8e6ff.2 [2026-10-31T19:28:42.406Z] "POST /llm/e2e-dft-4b0637/anything/e2e-dft-4b0637-0cb280 HTTP/1.1" 503 - - "-" 109 0 71 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "61c355f0-ffbb-4873-b539-af86c40d0ab0" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-4b0637.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:50996 - llm.external-model-e2e-dft-4b0637-d46eb2d8e6ff.2 [2026-10-31T19:29:03.770Z] "POST /llm/e2e-dft-4b0637/anything/e2e-dft-4b0637-0cb280 HTTP/1.1" 503 - - "-" 109 0 65 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "b59ee21a-fb76-4303-9dff-e808cce29c52" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-4b0637.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:40070 - llm.external-model-e2e-dft-4b0637-d46eb2d8e6ff.2 2026-10-31T19:29:59.266928Z info ads ADS: "" 1 terminated with stream closed 2026-10-31T19:30:00.331527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:30:33.657556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:31:17.605543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:32:19.667199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:33:56.251933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:48:16.922333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:48:48.452607Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:48:58.834102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:48:58.834139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:48:58.834150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:48:58.834154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T19:48:58.716Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 117 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "c303dae0-3dee-4e3b-8e4b-7784204af6a3" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:36444 10.133.0.213:443 10.132.0.17:53546 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T19:49:25.792516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:49:27.706195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:49:27.706233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:49:27.706250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:49:27.706257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T19:49:27.582Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 303 123 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "0a038241-ea1c-4de6-a471-79128c42f2f6" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:36444 10.133.0.213:443 10.132.0.17:53690 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T19:49:28.492Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 363 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "c11d8f68-8771-4638-b988-ae79fdab51a2" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.50:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:57954 10.133.0.213:443 10.132.0.17:53696 - v1-chat-completions-path [2026-10-31T19:49:29.524Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 329 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "a447736c-49ef-4517-b3bd-f98268a8bacc" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.50:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:57954 10.133.0.213:443 10.132.0.17:53700 - v1-chat-completions-path 2026-10-31T19:49:30.591840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T19:49:30.524Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 71 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "7e01dc5e-fbaa-4bf4-b258-9477bfa7eec3" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.50:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:57954 10.133.0.213:443 10.132.0.17:53712 - v1-chat-completions-path 2026-10-31T19:49:42.817983Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T19:49:42.818011Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T19:49:42.818015Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T19:49:42.818019Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T19:49:42.672Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 145 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "9cc399dc-a5c4-4e0e-832e-918923a6f0da" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:34470 - v1-catch-all-path 2026-10-31T19:49:44.238072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:49:48.833256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:49:51.462834Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-31T19:49:51.388Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "8d516e55-d138-403b-bf84-651447967921" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:57832 10.133.0.213:443 10.132.0.17:40664 - v1-catch-all-path 2026-10-31T19:49:51.727978Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-31T19:49:51.666Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 61 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "0c9f398f-0184-4aec-9904-d5dec4b713ac" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:57840 10.133.0.213:443 10.132.0.17:40672 - v1-catch-all-model-routing 2026-10-31T19:49:58.237716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:49:58.881275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:49:58.881318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:49:58.881332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:49:58.881336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T19:49:58.744Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 136 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "1070750c-c916-446c-8472-c65acb8a632e" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:36444 10.133.0.213:443 10.132.0.17:59356 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T19:50:04.020Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 58 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "2c866a47-acf4-4125-86aa-a0cfa042e300" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:54602 - v1-catch-all-path 2026-10-31T19:50:11.637684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:50:20.904612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:50:37.582176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:50:49.302125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:50:52.624134Z info ads ADS: new connection for node:4 2026-10-31T19:50:52.624461Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T19:50:52.624518Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T19:50:56.166112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:51:35.237562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T19:51:38.635Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 341 95 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "76b693a2-18f8-4428-aca8-f228783874f4" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.241:8000" outbound|54321||e2e-prio-pool-466e73b1-inference-pool-ip-e5cd0a4b.llm.svc.cluster.local 10.133.0.213:54412 10.133.0.213:443 10.132.0.17:34694 - v1-model-routing [2026-10-31T19:51:41.911Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 335 60 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "0f4555b7-9ea1-4984-8b0e-838d0d422a3f" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.241:8000" outbound|54321||e2e-prio-pool-466e73b1-inference-pool-ip-e5cd0a4b.llm.svc.cluster.local 10.133.0.213:47218 10.133.0.213:443 10.132.0.17:34700 - v1-model-routing [2026-10-31T19:51:57.230Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 32 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "13772804-1ef6-42ad-9eb6-e47560d87df6" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-466e73b1-inference-pool-ip-e5cd0a4b.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:33296 - v1-model-routing 2026-10-31T19:51:59.299771Z info ads ADS: "" 4 terminated 2026-10-31T19:51:59.724299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:52:04.560896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:52:18.068290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:54:19.696965Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T19:55:17.493837Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:55:45.554808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:10.371760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:26.025421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:39.382509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:51.340377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:56.254540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:56:59.369406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:56:59.369440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:56:59.369447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-31T19:56:59.369460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:56:59.369464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T19:56:59.251Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 117 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "9906c49c-ca82-43d0-90c8-683d6588153d" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:42710 10.133.0.213:443 10.132.0.17:56906 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T19:57:14.549599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:58:02.988224Z info ads ADS: new connection for node:5 2026-10-31T19:58:02.991898Z info cache read certificate from file resource=file-root:system 2026-10-31T19:58:06.985411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:58:08.014734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T19:58:41.466522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:58:41.466554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:58:41.466563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T19:58:41.466567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:58:41.466715Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T19:58:41.333Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 132 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "0867cfaf-fce6-47a7-a4d1-dbe0e4e2e29f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.213:50988 10.133.0.213:443 10.132.0.17:42128 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T19:58:50.811341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:58:50.811383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:58:50.811400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:58:50.811406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T19:58:50.811654Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T19:58:50.689Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 121 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3244b6b2-0e94-4670-ba19-c86f192d8c4e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.213:58166 10.133.0.213:443 10.132.0.17:54348 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T19:59:24.035315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:24.035356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:24.035371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T19:59:24.035376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T19:59:24.035597Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T19:59:23.882Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 153 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "7f6b85f7-9312-48a0-842e-2bd267aa08a9" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.213:58166 10.133.0.213:443 10.132.0.17:48988 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T19:59:30.978916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:59:30.978955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:59:30.978968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T19:59:30.978973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T19:59:30.979150Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-31T19:59:30.870Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 108 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "db496cd8-c8f8-41c1-9adc-603f127ded59" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.213:50988 10.133.0.213:443 10.132.0.17:49012 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T19:59:57.760728Z info ads ADS: "" 5 terminated with stream closed 2026-10-31T19:59:57.816991Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:00:00.376140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:00:11.008255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:00:29.567223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:00:34.142797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:00:38.135Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 74 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "232f5700-f3eb-417f-86f5-006e661ee884" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:41094 10.133.0.213:443 10.132.0.17:45614 - v1-completions-path 2026-10-31T20:00:55.064427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:01:11.973513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:01:18.810761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:01:18.810797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:01:18.810812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T20:01:18.810816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T20:01:18.703Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 107 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "701fcc9c-0792-4368-a698-1975838757b7" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:40158 10.133.0.213:443 10.132.0.17:42254 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T20:01:20.156Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "fdd4e223-a226-40c9-966f-c4034a7725f8" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:60406 10.133.0.213:443 10.132.0.17:42266 - v1-completions-path [2026-10-31T20:01:20.885Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "a2233097-a472-4559-a32f-57124cecdadc" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:42268 - v1-completions-path [2026-10-31T20:01:21.138Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "a288ecd5-396c-4937-9a52-07a6d1d34dca" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:60406 10.133.0.213:443 10.132.0.17:42274 - v1-completions-path [2026-10-31T20:01:24.757Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "645b09a1-f562-4cb9-a472-1720ae89d219" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:60406 10.133.0.213:443 10.132.0.17:43646 - v1-completions-path 2026-10-31T20:01:42.891497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:01:53.486061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:01:59.800841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:02:10.903Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "fd20a7ff-8521-4c82-b8b2-97bceb3bd2e1" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:60406 10.133.0.213:443 10.132.0.17:47866 - v1-completions-path [2026-10-31T20:02:12.768Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 59 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "32c7f73e-24a8-415e-a041-7ddc22d935d2" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:60406 10.133.0.213:443 10.132.0.17:47882 - v1-completions-path [2026-10-31T20:02:14.312Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "9e01112b-e0fc-9845-a534-9e4d7072e027" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:41094 10.133.0.213:443 10.132.0.17:60394 - v1-completions-path 2026-10-31T20:02:28.473626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:02:32.969358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:02:46.364315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:02:52.823885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:07.664963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:12.132452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:24.165280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:03:38.858866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:03:41.984Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 61 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "462e5e8c-fd31-40df-91c0-2fc4fa821542" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.213:443 10.132.0.17:48584 - v1-completions-path 2026-10-31T20:03:45.297430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:03.555573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:05.709969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:04:05.710014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:04:05.710034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:04:05.710041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T20:04:05.598Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 332 111 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "89edfa3b-ed00-472a-b99a-ab5ee06215c3" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:41762 10.133.0.213:443 10.132.0.17:57348 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T20:04:08.890641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:11.364949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:04:11.364986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:04:11.365001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:04:11.365005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T20:04:11.261Z] "DELETE /v1/api-keys/55f095f9-3f9a-47d5-969a-3dca8c400ecb HTTP/1.1" 200 - via_upstream - "-" 0 375 103 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "1eb6a1e8-586d-4ada-90b0-2723d773e115" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:41762 10.133.0.213:443 10.132.0.17:57368 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T20:04:20.184017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:32.414998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:04:32.415045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:04:32.415066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T20:04:32.415071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-31T20:04:32.300Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 114 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "dc008aca-dd07-410b-9068-694308964654" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:41330 10.133.0.213:443 10.132.0.17:39826 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T20:04:46.926559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:04:57.612040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:05:16.777722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:05:22.956786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:07:49.142907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:09:16.605545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:09:34.000727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:09:39.020286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:09:50.767216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:08.154648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:13.343669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:10:16.705Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 70 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "6c5a15a8-fd11-4fb6-9afb-1266cfb3fcc8" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:41094 10.133.0.213:443 10.132.0.17:57890 - v1-completions-path 2026-10-31T20:10:19.391051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:10:19.391088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T20:10:19.391103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T20:10:19.391107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T20:10:19.280Z] "DELETE /v1/api-keys/f089cc48-421c-4861-a935-6e7238c64bcb HTTP/1.1" 200 - via_upstream - "-" 0 369 110 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3e2b4535-69ff-4db7-b05f-d872747b6b12" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.255:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:37398 10.133.0.213:443 10.132.0.17:57898 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T20:10:33.359964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:44.213079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:10:50.470575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:11:05.490Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "7643f957-2fee-4c79-90e1-544e81b7437d" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:60406 10.133.0.213:443 10.132.0.17:33366 - v1-completions-path 2026-10-31T20:11:20.755617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:11:27.097132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:11:33.539187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:11:43.839Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3f640d89-c29c-4d01-8249-41788a4f00b7" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:41094 10.133.0.213:443 10.132.0.17:59072 - v1-completions-path [2026-10-31T20:11:45.917Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 61 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "9e275d04-4af0-4574-a64d-c162a29621c4" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:41094 10.133.0.213:443 10.132.0.17:59078 - v1-completions-path [2026-10-31T20:11:48.458Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "25904725-81c0-4d48-a54b-644ff5c3d7f8" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:60406 10.133.0.213:443 10.132.0.17:59094 - v1-completions-path [2026-10-31T20:11:49.553Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 68 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "b68fd642-aba5-4925-9859-efc0388b9432" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:41094 10.133.0.213:443 10.132.0.17:59098 - v1-completions-path 2026-10-31T20:12:05.613960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:12:16.319271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:12:23.078444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:12:29.151298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:12:41.125706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-31T20:12:48.147Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 69 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "e25ddb6b-cba1-4c1a-a554-cafdd7de7f26" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.213:41094 10.133.0.213:443 10.132.0.17:47194 - v1-completions-path 2026-10-31T20:12:51.143426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:12:51.143465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:12:51.143505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T20:12:51.143510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T20:12:51.031Z] "DELETE /v1/api-keys/1b951714-7d19-46fa-944f-a8d321e63e23 HTTP/1.1" 200 - via_upstream - "-" 0 367 112 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "edf9d861-9dd8-420b-9cbc-8e887ae0e069" "maas.apps.4cc86155c781c54889b2.prod.konflux-ocp-ci.dev" "10.134.0.255:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.213:51516 10.133.0.213:443 10.132.0.17:47218 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T20:13:04.726188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:15.337880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:20.191816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:38.486918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:13:45.044558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:14:08.673771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:14:30.896277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:14:31.238129Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-31T20:14:50.892753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:01.897790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:13.033852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:23.636177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:34.495699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:45.399527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:15:56.072762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-31T20:16:06.719443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9